-- Logs begin at Thu 2022-05-26 14:16:01 UTC, end at Thu 2022-05-26 15:29:44 UTC. -- May 26 14:59:33.347183 dv-cinder-788367-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 14:59:33.355968 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 14:59:33 2022] *** May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: nodename: dv-cinder-788367-11-iscsi May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: machine: x86_64 May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: clock source: unix May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: pcre jit disabled May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: detected number of CPU cores: 4 May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: current working directory: / May 26 14:59:33.358500 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: detected binary path: /usr/bin/uwsgi-core May 26 14:59:33.359192 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: your processes number limit is 47680 May 26 14:59:33.359192 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: your memory page size is 4096 bytes May 26 14:59:33.359192 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: detected max file descriptor number: 2048 May 26 14:59:33.359192 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: lock engine: pthread robust mutexes May 26 14:59:33.359192 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: thunder lock: enabled May 26 14:59:33.359192 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 14:59:33.359192 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 14:59:33.403359 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: Python main interpreter initialized at 0x55c1765569c0 May 26 14:59:33.403359 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: python threads support enabled May 26 14:59:33.403359 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: your server socket listen backlog is limited to 100 connections May 26 14:59:33.403359 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: your mercy for graceful operations on workers is 90 seconds May 26 14:59:33.403793 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: mapped 403077 bytes (393 KB) for 2 cores May 26 14:59:33.403793 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: *** Operational MODE: preforking *** May 26 14:59:33.404071 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: *** uWSGI is running in multiple interpreter mode *** May 26 14:59:33.404071 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: spawned uWSGI master process (pid: 103270) May 26 14:59:33.404290 dv-cinder-788367-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 14:59:33.404891 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 1 (pid: 103271, cores: 1) May 26 14:59:33.405198 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 2 (pid: 103272, cores: 1) May 26 14:59:33.405352 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 14:59:34.583706 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 14:59:34.595728 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 14:59:35.311210 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:59:35.311210 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes May 26 14:59:35.311533 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:59:35.311533 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes May 26 14:59:35.311781 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:59:35.311781 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes May 26 14:59:35.312257 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:59:35.312257 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes May 26 14:59:37.949881 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:59:37.950424 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:59:37.950424 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:59:37.951389 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:59:37.951389 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:59:37.951548 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:59:37.951646 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:59:37.951720 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:59:37.951796 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:59:37.951869 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:59:37.952071 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.952180 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.952387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.952483 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.952706 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.952799 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.953020 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.953107 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.953346 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.953435 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.953681 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.953767 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.954001 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.954097 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.954317 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.954412 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.954641 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.954726 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.954898 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.954992 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.955213 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.955298 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.955535 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788367-11-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.955619 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788367-11-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.955854 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.955949 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.956159 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.956244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.956468 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.956559 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.956784 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.956877 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.957085 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.957177 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.957404 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.957515 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.957734 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.957831 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.958233 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.958348 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.959543 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.959760 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.959957 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.960111 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.960300 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.960524 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.960524 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.960851 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.960851 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.961197 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.961384 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.961605 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.961810 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.962002 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.962002 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.962326 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.962508 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.962728 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.962915 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.963122 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.963311 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788367-11-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.963508 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788367-11-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.963508 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.963824 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.964003 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.964192 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.964390 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.964540 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.964715 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.964865 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.965000 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.965148 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.965275 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.965405 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.965556 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.965682 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.965846 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.965974 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.966098 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.966222 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.966886 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.967023 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.967189 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.967329 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.967464 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.967590 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.967720 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.967853 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.967985 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.968110 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.968233 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.968359 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.968489 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.968627 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.968760 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.968912 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.969038 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.969168 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.969293 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.969427 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.969613 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.969741 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.969924 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.970050 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.970174 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.970307 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.970441 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.970566 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.970696 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.970826 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.970962 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.971087 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.971213 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.971338 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.971463 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.971597 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.971722 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.971847 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.971971 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.972095 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.972232 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.972369 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.972509 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.972647 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.972771 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.972902 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.973026 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.973158 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.973282 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.973417 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.973575 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.973701 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.973837 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.973971 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.974095 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.974226 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.974350 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.974481 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.974616 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.974741 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.974863 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.974987 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.975116 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.975247 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.975383 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.975518 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.975644 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.975775 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.975907 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.976033 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.976165 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.976289 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.976414 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.976547 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.976679 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.976813 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.976937 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.977061 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.977184 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.977307 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.977431 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.977585 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.977719 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.977851 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.977976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.978100 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.978223 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.978356 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.978480 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.978611 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.978736 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.978868 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.978993 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.979201 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.979335 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.979466 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.979591 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.979714 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.979847 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.979972 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.980132 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.980262 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.980439 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.980567 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.980743 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.980880 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.981042 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.981172 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.981345 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.981533 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.981674 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.981799 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.981991 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.982119 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.982295 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.982428 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.982596 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.982726 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.982895 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.983029 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.983196 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.983322 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.983496 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.983629 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.983796 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.983922 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.984108 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.984252 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.984423 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.984551 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.984725 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.984858 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.985029 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.985167 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.985330 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.985480 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.985657 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.985799 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.985971 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.986108 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.986272 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.986400 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.986574 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.986701 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.986891 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.987025 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.987193 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.987322 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.987491 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.987618 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.987803 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.987938 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.988106 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.988241 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.988408 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.988536 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.988722 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.988862 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.989018 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.989145 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.989322 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.989549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.989677 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.989822 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.989956 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.990081 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.990246 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.990389 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.990610 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.990755 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.990881 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.991011 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.991141 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.991274 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.991421 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.991537 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.991968 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.992103 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.992209 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.992332 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.992471 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.992607 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.992738 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.992862 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.992984 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.993105 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.993240 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.993368 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.993524 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.993650 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.993823 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.993959 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.994143 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.994272 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:59:37.994479 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.994613 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.994810 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.994945 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.995147 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.995315 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.995462 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.995587 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.995779 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.995916 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.996106 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.996233 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.996421 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.996546 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.996729 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.996866 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.997039 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.997173 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.997362 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.997587 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.997728 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.997854 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.998020 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.998148 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.998330 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.998457 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.998645 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.998774 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.998960 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.999106 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.999287 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.999424 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:37.999601 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.000069 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.000208 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.000340 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.000472 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.000597 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.000779 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.000909 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.001093 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.001220 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.001417 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.001567 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.001764 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.001896 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.002072 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.002193 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.002409 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.002505 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.002748 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.002835 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.003055 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.003149 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.003376 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.003475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.003695 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.003787 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.004005 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.004091 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.004311 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.004408 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.004618 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.004703 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.004936 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.005065 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.005265 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.005420 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.005626 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.005752 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.005889 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.006015 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.006203 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.006345 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.006513 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.006639 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.006817 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.006942 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.007124 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.007261 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.007430 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.007568 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.007762 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.007889 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.008073 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.008201 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.008386 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.008522 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.008694 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.008820 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.009005 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.009133 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.009312 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.009437 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.009644 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.009771 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.009955 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.010082 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.010257 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.010384 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.010557 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.010683 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.010856 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.010983 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.011161 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.011321 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.011448 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.011588 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.011763 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.011893 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.012087 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.012217 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.012392 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.012529 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.012723 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.012851 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.013025 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.013686 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.013867 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.014014 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.014175 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.014303 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.014482 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.014618 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.014783 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.014912 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.015093 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.015223 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.015400 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.015529 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.015701 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.015837 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.016020 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.016148 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.016326 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.016468 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.016628 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.016758 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.016947 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.017075 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.017248 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.017376 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.017573 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.017704 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.017886 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.018022 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.018192 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.018329 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.018499 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.018629 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.018806 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.018935 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.019114 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.019252 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.019432 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.019560 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.019742 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.019870 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.020050 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.020187 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.020382 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.020522 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.020707 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.020835 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.021007 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.021144 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.021325 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.021476 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.021668 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.021797 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.021983 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.022123 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.022282 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.022402 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.022587 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.022722 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.022886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.023022 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.023184 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.023321 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.023482 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.023610 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.023786 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.023915 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.024082 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.024208 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.024379 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.024517 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.024676 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.024804 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.024974 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.025109 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.025271 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.025399 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.025612 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.025743 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.025919 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.026047 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.026219 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.026356 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.026519 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.026655 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.026819 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.026948 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.027154 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.027291 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.027457 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.027586 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.027793 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.027920 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.028123 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.028261 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.028438 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.028573 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.028824 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.029444 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.029640 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.029850 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.029987 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.030119 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.030245 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.030370 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.030548 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.030671 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.030856 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.030977 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.031164 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.031279 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.031480 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.031593 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.031788 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.031927 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.032106 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.032242 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.032414 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.032534 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.032730 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.032865 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.033038 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.033165 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.033352 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.033522 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.033679 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.033818 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.033990 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.034118 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.034326 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.034454 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.034655 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.034783 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.034968 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.035109 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.035287 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.035426 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.035594 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.035721 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.035903 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.036039 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.036208 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.036335 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.036516 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.036643 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.036822 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.036960 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.037129 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.037256 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.037442 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.037593 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.037774 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.037916 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.038091 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.038220 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.038399 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.038528 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.038717 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.038859 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.039024 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.039154 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.039336 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.039464 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.039637 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.039766 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.039948 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.040083 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.040272 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.040399 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.040598 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.040727 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.040903 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.041031 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.041209 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.041337 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.041532 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.041660 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.041846 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.041982 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.042150 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.042278 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.042455 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.042590 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.042756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.042884 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.043056 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.043193 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.043361 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.043489 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.043700 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.043827 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.043973 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.044100 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.044277 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.044434 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.044604 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.044733 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.044915 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.045057 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.045221 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.045351 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.045545 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.045675 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.045844 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.045983 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.046151 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.046287 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.046464 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.046593 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.046770 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.046900 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.047085 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.047213 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.047400 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.047528 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.047701 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.047839 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.048000 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.048135 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.048317 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.048447 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.048623 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.048751 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.048922 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.049051 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.049221 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.049357 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.049540 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.049668 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.049870 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.050002 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.050176 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.050318 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.050476 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.050604 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.050786 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.050914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.051102 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.051244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.051403 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.051530 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.051711 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.051839 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.052022 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.052161 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.052328 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.052458 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.052644 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.052771 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.052952 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.053088 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.053258 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.053387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.053589 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.053729 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.053896 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.054032 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.054201 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.054330 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.054508 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.054636 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.054822 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.054950 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.055128 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.055257 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.055434 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.055564 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.055736 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.055872 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.056036 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.056164 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.056342 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.056470 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.056654 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.056784 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.057227 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.057356 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.057579 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.057721 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.057893 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.058022 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.058208 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.058336 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.058525 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.058736 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.058864 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.058995 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.059148 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.059278 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.059471 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.059612 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.059809 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.060461 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.060634 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.060772 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.060937 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.061073 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.061240 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.061379 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.061564 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.061697 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.061872 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.061999 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.062174 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.062315 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.062472 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.062611 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.062770 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.062899 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.063074 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.063211 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.063374 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.063501 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.063671 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.063800 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.063969 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.064106 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.064265 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.064401 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.064573 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.064703 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.064873 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.065001 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.065177 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.065304 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.065491 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.065616 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.065810 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.065948 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.066115 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.066251 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.066413 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.066541 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.066712 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.066841 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.067008 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.067137 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.067343 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.067473 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.067643 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.067779 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.067975 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.068104 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.068297 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.068430 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.068634 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.068762 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.068935 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.069063 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.069236 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.069377 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.069579 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.069708 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.069883 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.070013 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.070181 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.070321 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.070480 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.070609 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.070785 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.070912 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.071088 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.071227 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.071384 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.071512 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.071688 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.071816 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.071996 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.072128 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.072299 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.072435 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.072603 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.072735 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.072901 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.073022 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.073204 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.073341 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.073524 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.073656 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.073837 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.073973 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.074141 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.074277 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.074439 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.074566 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.074736 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.074866 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.075042 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.075170 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.075344 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.075486 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.076182 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.076331 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.076480 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.076610 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.076781 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.076918 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.077093 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.077222 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.077391 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.077583 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.077710 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.077849 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.078005 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.078135 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.078308 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.078437 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.078611 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.078748 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.078911 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.079047 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.079225 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.079353 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.079530 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.079659 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.079828 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.079955 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.080125 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.080261 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.080429 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.080559 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.080725 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.080861 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.081024 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.081152 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.081329 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.081483 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.081671 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.081800 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.081987 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.082117 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.082284 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.082414 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.082590 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.082719 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.082891 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.083085 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.083220 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.083358 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.083483 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.083611 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.083768 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.083908 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.084065 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.084202 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.084363 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.084492 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.084661 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.084803 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.084959 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.085087 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.085256 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.085383 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.085595 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.085738 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.085902 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.086030 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.086203 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.086331 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.086502 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.086640 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.086800 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.086929 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.087136 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.087264 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.087436 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.087565 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.087788 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.087915 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.088087 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.088222 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.088397 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.088532 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.088709 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.088837 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.089015 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.089143 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.089321 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.089467 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.089658 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.089785 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.089959 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.090100 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.090271 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.090398 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.090577 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.090767 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.090895 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.091028 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.091161 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.091866 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.092072 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.092210 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.092336 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.092468 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.092594 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.092717 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.092881 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.093010 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.093198 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.093333 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.093537 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.093679 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.093859 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.093993 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.094158 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.094295 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.094462 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.094592 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.094767 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.094901 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.095071 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.095202 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.095374 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.095510 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.095677 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.095803 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.095982 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.096121 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.096289 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.096425 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.096593 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.096726 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.096898 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.097033 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.097201 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.097328 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.097526 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.097667 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.097835 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.097979 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.098139 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.098268 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.098437 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.098574 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.098755 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.098885 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.099062 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.099190 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.099359 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.099496 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.099663 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.099792 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.099963 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.100099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.100268 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.100406 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.100566 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.100693 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.100992 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.101119 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.101297 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.101433 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.101628 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.101758 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.101928 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.102064 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.102237 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.102373 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.102542 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.102669 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.102852 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.102983 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.103163 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.103292 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.103460 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.103589 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.103871 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.104000 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.104177 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.104306 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.104524 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.104663 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.104790 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.104924 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.105063 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.105190 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.105423 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.105581 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.105709 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.105851 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.105979 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.106112 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.106276 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.106407 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.106579 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.106713 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.106922 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.107550 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.107741 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.107872 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.108042 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.108180 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.108358 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.108486 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.108769 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.108899 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.109077 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.109218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.109377 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.109561 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.109816 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.109947 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.110123 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.110260 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.110429 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.110565 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.110745 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.110873 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.111062 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.111190 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.111378 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.111515 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.111679 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.111827 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.111989 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.112120 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.112295 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.112425 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.112612 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.112739 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.112930 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.113072 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.113237 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.113365 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.113568 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.113698 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.113870 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.113999 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.114186 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.114324 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.114502 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.114631 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.114811 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.114947 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.115126 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.115255 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.115535 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.115672 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.115853 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.115989 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.116160 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.116289 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.116476 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.116611 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.116794 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.116931 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.117095 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.117227 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.117393 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.117551 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.117729 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.117865 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.118036 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.118178 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.118339 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.118470 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.118658 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.118789 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.118960 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.119090 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.119268 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.119397 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.119570 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.119699 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.119874 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.120002 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.120175 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.120303 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.120474 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.120612 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.120791 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.120918 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.121088 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.121217 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.121403 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.121596 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.121741 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.121876 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.122041 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.122186 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.122358 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.122542 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.122683 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.122809 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.122993 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.123168 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.123296 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.123420 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.123586 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.123715 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.123885 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.124028 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.124183 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.124327 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.124515 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.124654 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.125063 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.125192 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.125381 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.125528 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.125734 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.125864 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.126058 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.126188 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.126363 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.126491 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.126694 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.126823 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.127015 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.127153 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.127325 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.127453 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.127638 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.127774 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.127956 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.128086 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.128255 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.128384 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.128553 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.128690 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.128857 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.128986 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.129156 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.129285 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.129471 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.129621 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.129774 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.129920 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.130079 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.130208 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.130377 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.130581 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.130718 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.130845 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.130970 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.131095 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.131263 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.131407 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.131560 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.131689 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.131874 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.132003 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.132176 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.132306 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.132475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.132602 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.132772 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.132901 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.133071 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.133200 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.133404 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.133556 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.133730 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.133858 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.134060 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.134191 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.134377 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.134511 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.134691 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.135014 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.135225 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.135342 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.135631 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.135801 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.136115 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.136385 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.136542 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.136706 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.136987 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.137118 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.137306 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.137484 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.137646 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.137775 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.137959 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.138129 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.138294 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.138505 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.138642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.138775 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.138901 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.139026 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.139198 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.139336 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.139509 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.139645 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.139818 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.140048 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.140186 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.140382 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.140651 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.140782 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.140981 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.141112 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.141297 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.141428 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.141633 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.141775 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.141945 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.142075 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.142260 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.142390 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.142567 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.142704 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.142877 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.143013 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.143184 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.143312 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.143492 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.143622 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.143801 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.143939 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.144129 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.144266 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.144448 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.144586 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.144767 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.144907 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.145082 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.145212 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.145396 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.145590 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.145730 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.145857 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.146038 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.146167 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.146351 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.146483 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.146670 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.146791 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.146982 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.147111 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.147295 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.147434 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.147606 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.147735 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.147913 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.148048 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.148223 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.148369 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.148532 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.148662 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.148839 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.148967 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.149148 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.149286 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.149472 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.149616 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.149790 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.149920 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.150099 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.150229 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.150410 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.150538 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.150724 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.150846 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.151047 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.151181 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.151355 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.151482 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.151667 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.151797 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.151981 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.152110 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.152290 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.152507 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.152636 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.152819 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.153104 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.153234 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.153417 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.153565 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.154300 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.154447 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.154629 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.154760 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.154942 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.155071 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.155255 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.155393 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.155558 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.155686 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.155862 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.155992 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.156172 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.156310 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.156471 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.156600 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.156835 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.156974 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.157101 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.157215 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.157363 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.157549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.157702 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.157831 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.158007 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.158150 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.158309 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.158439 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.158630 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.158833 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.158971 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.159179 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.159456 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.159586 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.159802 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.159938 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.160115 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.160245 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.160426 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.160554 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.160731 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.160870 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.161046 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.161175 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.161346 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.161504 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.161678 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.161818 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.161981 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.162110 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.162286 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.162424 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.162586 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.162728 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.162889 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.163018 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.163193 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.163321 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.163497 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.163639 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.163798 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.163928 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.164104 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.164232 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.164404 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.164532 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.164711 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.164838 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.165016 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.165144 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.165319 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.165471 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.165646 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.165776 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.165954 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.166084 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.166257 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.166386 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.166557 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.166686 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.166856 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.166977 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.167155 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.167283 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.167455 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.167585 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.167753 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.167958 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.168086 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.168211 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.168335 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.168472 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.168641 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.168781 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.168939 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.169066 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.169243 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.169419 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.170120 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.170267 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.170438 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.170565 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.170763 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.170891 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.171065 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.171205 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.171373 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.171502 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.171676 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.171807 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.171990 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.172127 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.172299 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.172429 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.172605 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.172733 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.172915 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.173044 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.173226 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.173355 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.173590 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.173795 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.173935 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.174127 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.174426 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.174558 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.174759 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.174890 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.175080 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.175211 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.175381 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.175509 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.175682 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.175822 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.175986 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.176117 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.176308 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.176439 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.176613 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.176751 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.176918 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.177048 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.177226 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.177364 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.177608 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.177754 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.177882 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.178015 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.178142 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.178266 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.178438 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.178575 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.178743 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.178872 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.179047 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.179175 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.179351 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.179479 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.179654 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.179780 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.179958 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.180086 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.180260 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.180387 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.180565 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.180693 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.180871 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.181001 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.181184 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.181323 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.181523 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.181652 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.181840 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.181983 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.182154 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.182283 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.182465 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.182591 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.182774 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.182917 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.183079 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.183216 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.183385 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.183514 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.183692 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.183831 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.183999 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.184128 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.184310 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.184444 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.184614 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.184744 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.184951 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.185090 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.185264 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.185412 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.185707 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.185837 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.186018 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.186146 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.186327 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.186465 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.186644 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.186774 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.186955 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.187086 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.187263 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.187393 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.187581 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.187711 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.187887 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.188016 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.188204 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.188346 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.188513 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.188644 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.188838 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.188968 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.189162 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.189299 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.189484 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.189636 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.189794 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.189924 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.190097 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.190228 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.190421 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.190555 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.190690 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.190817 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.190999 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.191138 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.191299 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.191427 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.191599 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.191729 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.191901 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.192029 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.192202 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.192329 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.192503 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.192632 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.192803 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.192932 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.193103 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.193230 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.193401 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.193558 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.193727 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.193866 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.194027 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.194155 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.194324 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.194462 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.194622 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.194742 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.194919 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.195047 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.195217 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.195357 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.195516 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.195644 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.195815 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.195950 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.196115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.196254 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.196413 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.196542 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.196709 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.196854 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.197055 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.197189 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.197305 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.197429 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.197631 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.197794 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.197932 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.198067 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.198235 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.198365 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.198546 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.198676 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.198861 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.198990 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.199168 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.199296 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.199483 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.199610 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.199786 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.199957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.200093 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.200225 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.200393 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.200552 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.200733 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.200861 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.201043 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.201174 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.201349 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.201510 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.201692 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.201835 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.201998 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.202135 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.202309 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.202448 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.202614 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.202742 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.202924 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.203061 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.203233 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.203364 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.203540 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.203676 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.203862 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.203992 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.204165 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.204304 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.204481 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.204610 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.204793 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.204930 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.205102 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.205239 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.205426 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.205602 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.205761 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.205904 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.206070 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.206201 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.206383 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.206512 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.206694 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.206833 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.207004 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.207134 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.207439 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.207628 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.207757 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.207942 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.208070 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.208260 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.208388 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.208567 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.208703 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.208889 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.209026 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.209199 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.209328 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.209546 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.209677 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.209872 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.209999 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.210213 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.210342 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.210523 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.210661 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.210835 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.210963 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.211145 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.211274 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.211445 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.211574 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.211698 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:59:38.211823 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.212071 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:59:38.212315 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:59:38.273663 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Registered counter for database nova_api May 26 14:59:38.276625 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Registered counter for database nova_api May 26 14:59:38.295252 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:38.296965 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:38.302111 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:38.303676 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:38.360134 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.context [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6457610-a8a6-401c-aab2-670bbc3dd86d(cell1) {{(pid=103272) load_cells /opt/stack/nova/nova/context.py:464}} May 26 14:59:38.360990 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.context [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6457610-a8a6-401c-aab2-670bbc3dd86d(cell1) {{(pid=103271) load_cells /opt/stack/nova/nova/context.py:464}} May 26 14:59:38.364307 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:59:38.365333 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:59:38.365910 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:59:38.366731 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:59:38.366952 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:59:38.367768 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:59:38.368743 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:59:38.369845 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:59:38.374219 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Registered counter for database nova_cell0 May 26 14:59:38.374333 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Registered counter for database nova_cell0 May 26 14:59:38.375811 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Registered counter for database nova_cell1 May 26 14:59:38.377094 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Registered counter for database nova_cell1 May 26 14:59:38.383475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:38.385995 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:38.389160 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:38.390287 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:38.394527 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:38.400260 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:38.528210 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:38.534468 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:38.543261 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Registered counter for database nova_cell0 May 26 14:59:38.546583 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Registered counter for database nova_cell0 May 26 14:59:38.552897 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:38.554485 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:59:38.558933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:38.559452 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 14:59:38.899212 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:59:38.906435 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:59:38.907114 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:59:38.913722 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:59:39.252338 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:59:39.258281 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:59:39.258604 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:59:39.264066 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1765569c0 pid: 103271 (default app) May 26 14:59:39.265090 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-3d956c0e-4d4e-49ff-8c5a-edda04c58d20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:59:39.266269 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:39.267458 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001784 May 26 14:59:39.267873 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu May 26 14:59:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:39.270829 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1765569c0 pid: 103272 (default app) May 26 15:00:59.775455 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:59.776548 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 May 26 15:00:59.777110 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:00:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:59.789791 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:59.790949 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:59.792011 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell1:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:00:59.793950 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:00.265561 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e4268815-05a6-4f55-9c5b-78217e2b3eb3 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:00.296528 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e4268815-05a6-4f55-9c5b-78217e2b3eb3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.511906 May 26 15:01:00.297261 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Thu May 26 15:00:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:02.618862 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:02.620971 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-3d8fbebc-95bd-44f4-8579-d34798d11511 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 26 15:01:02.620971 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:02.688879 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-eeb1b57a-e5e8-46d7-a443-4a7c168d2477 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:02.706865 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:02.706865 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: warnings.warn(msg) May 26 15:01:02.736683 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-eeb1b57a-e5e8-46d7-a443-4a7c168d2477 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106992 May 26 15:01:02.737345 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:02.751890 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:02.754229 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:02.755930 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:02.757141 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:02.966184 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-020f9fde-7acd-431b-983b-f32ccb155908 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:02.968703 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:02.968703 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: warnings.warn(msg) May 26 15:01:03.034681 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-020f9fde-7acd-431b-983b-f32ccb155908 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289116 May 26 15:01:03.041960 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 15:01:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:05.375620 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-eeb1b57a-e5e8-46d7-a443-4a7c168d2477 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:05.377611 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-eeb1b57a-e5e8-46d7-a443-4a7c168d2477 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002384 May 26 15:01:05.378016 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:05.512175 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a56dc816-c4b3-4e65-b584-1feef2951624 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:05.529713 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:05.529713 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: warnings.warn(msg) May 26 15:01:05.553545 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a56dc816-c4b3-4e65-b584-1feef2951624 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.168993 May 26 15:01:05.554187 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:05.567478 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-d26c5ccf-af40-4fcb-b395-68634c1c1d76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:05.569146 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:05.569146 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: warnings.warn(msg) May 26 15:01:05.606559 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-d26c5ccf-af40-4fcb-b395-68634c1c1d76 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042696 May 26 15:01:05.625573 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 15:01:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:07.908568 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a56dc816-c4b3-4e65-b584-1feef2951624 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:07.909710 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a56dc816-c4b3-4e65-b584-1feef2951624 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 26 15:01:07.910114 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:07.974671 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-3e44d3ca-c85d-45a4-81c3-0a727f945288 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 10}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:07.994822 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-3e44d3ca-c85d-45a4-81c3-0a727f945288 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078310 May 26 15:01:07.995481 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:08.008364 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-cd3c0fef-d7c8-4bb8-9ff0-bf8b7f7738f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:08.039153 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-cd3c0fef-d7c8-4bb8-9ff0-bf8b7f7738f1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033993 May 26 15:01:08.049492 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 15:01:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:10.397426 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-3e44d3ca-c85d-45a4-81c3-0a727f945288 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:10.398402 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-3e44d3ca-c85d-45a4-81c3-0a727f945288 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 26 15:01:10.398820 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:10.463502 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a6cac39d-cd6b-4bea-90ce-989fdc4d9f14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2, "id": "d3", "disk": 10, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:10.483923 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a6cac39d-cd6b-4bea-90ce-989fdc4d9f14 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077579 May 26 15:01:10.484492 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:10.497177 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-6c6a41c1-b94e-4931-abe2-49e1a850f668 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:10.528292 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-6c6a41c1-b94e-4931-abe2-49e1a850f668 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034394 May 26 15:01:10.529624 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 15:01:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:12.865629 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a6cac39d-cd6b-4bea-90ce-989fdc4d9f14 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:12.866659 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a6cac39d-cd6b-4bea-90ce-989fdc4d9f14 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 26 15:01:12.867067 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:12.935597 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-bcbf07c4-7fa2-4e23-ad1d-1b9967d2c529 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "disk": 20, "ram": 4096, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:12.954390 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-bcbf07c4-7fa2-4e23-ad1d-1b9967d2c529 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079442 May 26 15:01:12.955201 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:12.966837 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c8222b44-23dc-4e9a-b4c5-3634d3268c46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:12.990341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c8222b44-23dc-4e9a-b4c5-3634d3268c46 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027213 May 26 15:01:12.991024 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Thu May 26 15:01:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:15.299727 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-bcbf07c4-7fa2-4e23-ad1d-1b9967d2c529 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:15.301310 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-bcbf07c4-7fa2-4e23-ad1d-1b9967d2c529 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 May 26 15:01:15.302526 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:15.372012 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-aa777469-9db9-4ccc-95dd-27d1a6f0ed10 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:15.403098 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-aa777469-9db9-4ccc-95dd-27d1a6f0ed10 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.094419 May 26 15:01:15.404021 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Thu May 26 15:01:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:17.836907 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-bcbf07c4-7fa2-4e23-ad1d-1b9967d2c529 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:17.838770 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-bcbf07c4-7fa2-4e23-ad1d-1b9967d2c529 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002286 May 26 15:01:17.839740 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:17.913269 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-6a7a23b5-296e-47a2-b69a-b0596086ca71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:17.931886 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-6a7a23b5-296e-47a2-b69a-b0596086ca71 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084030 May 26 15:01:17.932464 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:17.944899 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-4a550ece-6449-4b2a-bbb9-3260751d5a04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:17.969874 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-4a550ece-6449-4b2a-bbb9-3260751d5a04 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028622 May 26 15:01:17.970471 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 15:01:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:20.441967 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-6a7a23b5-296e-47a2-b69a-b0596086ca71 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:20.443234 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-6a7a23b5-296e-47a2-b69a-b0596086ca71 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001794 May 26 15:01:20.443762 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:20.525730 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-437654c4-0721-4022-966f-3f595929555a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "name": "m1.small", "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:20.553971 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-437654c4-0721-4022-966f-3f595929555a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.102527 May 26 15:01:20.554651 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:20.569536 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-89bd6ad6-174e-4b96-b4d5-dd1d61369e76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:20.600676 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-89bd6ad6-174e-4b96-b4d5-dd1d61369e76 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036192 May 26 15:01:20.601290 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 15:01:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:23.021124 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-437654c4-0721-4022-966f-3f595929555a admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:23.022356 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-437654c4-0721-4022-966f-3f595929555a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001826 May 26 15:01:23.022871 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:23.096809 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-779cd1ae-4bc8-47a4-9c97-90f0a0ab970e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:23.124605 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-779cd1ae-4bc8-47a4-9c97-90f0a0ab970e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.095101 May 26 15:01:23.125575 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:23.139976 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-54515fe0-af67-42f5-8fb0-50e847b5dbf2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:23.166136 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-54515fe0-af67-42f5-8fb0-50e847b5dbf2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030530 May 26 15:01:23.167503 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 15:01:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:25.523385 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-779cd1ae-4bc8-47a4-9c97-90f0a0ab970e admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:25.524415 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-779cd1ae-4bc8-47a4-9c97-90f0a0ab970e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 May 26 15:01:25.524836 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:25.594921 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-125bc45b-00df-4ea6-837f-1692605b9fb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "vcpus": 4}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:25.620234 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-125bc45b-00df-4ea6-837f-1692605b9fb0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.087994 May 26 15:01:25.621686 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:25.636802 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-28163e79-8d83-4420-a118-c8fd4a56ea6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:25.662355 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-28163e79-8d83-4420-a118-c8fd4a56ea6c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030615 May 26 15:01:25.669990 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 15:01:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:27.969694 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-125bc45b-00df-4ea6-837f-1692605b9fb0 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:27.970948 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-125bc45b-00df-4ea6-837f-1692605b9fb0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 May 26 15:01:27.971349 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:28.050751 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-26b3aefc-ee35-47f8-ae8b-4524f4f50062 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:28.070349 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-26b3aefc-ee35-47f8-ae8b-4524f4f50062 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.092662 May 26 15:01:28.071018 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Thu May 26 15:01:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:28.083382 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c9b5b6d2-99d9-4964-a3fd-61338b858897 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:28.110871 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c9b5b6d2-99d9-4964-a3fd-61338b858897 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030722 May 26 15:01:28.129538 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Thu May 26 15:01:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:53.150329 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-26b3aefc-ee35-47f8-ae8b-4524f4f50062 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:53.151845 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-26b3aefc-ee35-47f8-ae8b-4524f4f50062 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 May 26 15:01:53.152256 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:01:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:53.162963 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:53.211348 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f54cf251-7576-4a40-93bf-9ee80fb08b6e admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:53.228724 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f54cf251-7576-4a40-93bf-9ee80fb08b6e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070348 May 26 15:01:53.229263 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Thu May 26 15:01:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:54.216287 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-26b3aefc-ee35-47f8-ae8b-4524f4f50062 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:54.217325 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-26b3aefc-ee35-47f8-ae8b-4524f4f50062 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 26 15:01:54.217757 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:54.424696 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-65bd9d5b-ece7-409f-8b64-85ceebd318b0 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:54.430286 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-65bd9d5b-ece7-409f-8b64-85ceebd318b0 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-65bd9d5b-ece7-409f-8b64-85ceebd318b0 admin admin] Request method failure captured: May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Accept: application/json May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Connection: keep-alive May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Content-Length: 0 May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Host: 10.222.0.46 May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABij5ZihFmdv0jlyVdC3jBbyEUqzWprJoTHDa4uvVbmKCH8K2Am4VCoZmP4W_XkyEGW2Fro__QihkCQrs9M10gZSj_D8qtPA9HIqdZCqLo6Iplj0wFHpS418iKJfPS0BzdcTftzC8MhUqJhGnZ0wZjPkpuLZUexV1edi2CNN1U4pzt0aXE May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Domain-Id: None May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Domain-Name: None May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Name: admin May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Role: admin,reader,member May 26 15:01:54.433475 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Roles: admin,reader,member May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_064fc3c7af494c988e44e426f21b1c78", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/064fc3c7af494c988e44e426f21b1c78"}]}] May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant: admin May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User: admin May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Id: dede0ef3af5b453796bce68732b5fd29 May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Name: admin May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: method: > May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: exception: Flavor 42 could not be found. May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: action_args: {'id': '42'} May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:54.435115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:54.436244 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:54.437642 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-65bd9d5b-ece7-409f-8b64-85ceebd318b0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:54.438883 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-65bd9d5b-ece7-409f-8b64-85ceebd318b0 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063776 May 26 15:01:54.438883 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu May 26 15:01:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:54.444581 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-2f0ae527-08db-4ade-882a-f4f177ab4005 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:54.447602 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:01:54.467846 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-2f0ae527-08db-4ade-882a-f4f177ab4005 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026753 May 26 15:01:54.468400 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 15:01:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:54.478104 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-260ef7be-d5f5-452f-995b-34e15901144f admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:54.498869 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-260ef7be-d5f5-452f-995b-34e15901144f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024349 May 26 15:01:54.499398 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 15:01:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:54.510388 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-79160569-d6b5-4d97-a3fa-f5470a7c8def admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:54.516983 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-79160569-d6b5-4d97-a3fa-f5470a7c8def admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-79160569-d6b5-4d97-a3fa-f5470a7c8def admin admin] Request method failure captured: May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Accept: application/json May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Connection: keep-alive May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Content-Length: 0 May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Host: 10.222.0.46 May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABij5ZihFmdv0jlyVdC3jBbyEUqzWprJoTHDa4uvVbmKCH8K2Am4VCoZmP4W_XkyEGW2Fro__QihkCQrs9M10gZSj_D8qtPA9HIqdZCqLo6Iplj0wFHpS418iKJfPS0BzdcTftzC8MhUqJhGnZ0wZjPkpuLZUexV1edi2CNN1U4pzt0aXE May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Domain-Id: None May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Domain-Name: None May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Name: admin May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Role: admin,reader,member May 26 15:01:54.520341 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Roles: admin,reader,member May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_064fc3c7af494c988e44e426f21b1c78", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/064fc3c7af494c988e44e426f21b1c78"}]}] May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant: admin May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User: admin May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Id: dede0ef3af5b453796bce68732b5fd29 May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Name: admin May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: method: > May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: exception: Flavor 42 could not be found. May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: action_args: {'id': '42'} May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:54.521892 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:54.522976 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:54.524301 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-79160569-d6b5-4d97-a3fa-f5470a7c8def admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:54.525549 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-79160569-d6b5-4d97-a3fa-f5470a7c8def admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016144 May 26 15:01:54.525549 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu May 26 15:01:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 15:01:55.419242 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-260ef7be-d5f5-452f-995b-34e15901144f admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:55.420225 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-260ef7be-d5f5-452f-995b-34e15901144f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 26 15:01:55.420636 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:01:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:01:55.612700 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c579870f-141d-4aef-a002-6f328a63c253 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:55.618208 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-c579870f-141d-4aef-a002-6f328a63c253 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c579870f-141d-4aef-a002-6f328a63c253 admin admin] Request method failure captured: May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Accept: application/json May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Connection: keep-alive May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Content-Length: 0 May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Host: 10.222.0.46 May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABij5ZjhLOTeWjaWlyHtVf3lkWxyKHIuzd3n4HLykjcOn0nWiWpUQTGg4g0-EnT-TpLuwOzyfxPuos9buO7347Of-Q_ohIv43ErCakvJGnxIBKu0YwguFZAPYRN0k4ocU0DmBTweeFIEp_UCFeqJwsVRBPQVdctEPBHy_5l3DHxdX5UWR8 May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Domain-Id: None May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Domain-Name: None May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Name: admin May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Role: admin,reader,member May 26 15:01:55.619756 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Roles: admin,reader,member May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_064fc3c7af494c988e44e426f21b1c78", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/064fc3c7af494c988e44e426f21b1c78"}]}] May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant: admin May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User: admin May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Id: dede0ef3af5b453796bce68732b5fd29 May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Name: admin May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: method: > May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: exception: Flavor 84 could not be found. May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: action_args: {'id': '84'} May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:55.621157 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:55.622218 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:55.623319 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-c579870f-141d-4aef-a002-6f328a63c253 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:55.624714 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-c579870f-141d-4aef-a002-6f328a63c253 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063293 May 26 15:01:55.624714 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu May 26 15:01:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:55.631462 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-1542718f-8ee4-47e6-ba77-fac4006476d2 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:55.646956 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-1542718f-8ee4-47e6-ba77-fac4006476d2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019173 May 26 15:01:55.647506 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 15:01:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:55.657831 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-6fb1dee7-5d9f-4f34-88f0-5257f15c1fe7 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:55.672511 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-6fb1dee7-5d9f-4f34-88f0-5257f15c1fe7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018127 May 26 15:01:55.673071 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 15:01:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:55.682572 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-45ba48f3-b50b-481b-9623-bbf36866fe01 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:55.688016 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-45ba48f3-b50b-481b-9623-bbf36866fe01 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-45ba48f3-b50b-481b-9623-bbf36866fe01 admin admin] Request method failure captured: May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Accept: application/json May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Connection: keep-alive May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Content-Length: 0 May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Host: 10.222.0.46 May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABij5ZjhLOTeWjaWlyHtVf3lkWxyKHIuzd3n4HLykjcOn0nWiWpUQTGg4g0-EnT-TpLuwOzyfxPuos9buO7347Of-Q_ohIv43ErCakvJGnxIBKu0YwguFZAPYRN0k4ocU0DmBTweeFIEp_UCFeqJwsVRBPQVdctEPBHy_5l3DHxdX5UWR8 May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Domain-Id: None May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Domain-Name: None May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Name: admin May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Role: admin,reader,member May 26 15:01:55.689549 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Roles: admin,reader,member May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_064fc3c7af494c988e44e426f21b1c78", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/064fc3c7af494c988e44e426f21b1c78"}]}] May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant: admin May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User: admin May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Id: dede0ef3af5b453796bce68732b5fd29 May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Name: admin May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: method: > May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: exception: Flavor 84 could not be found. May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: action_args: {'id': '84'} May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:55.690984 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:55.691886 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:55.693035 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-45ba48f3-b50b-481b-9623-bbf36866fe01 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:55.694090 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-45ba48f3-b50b-481b-9623-bbf36866fe01 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011981 May 26 15:01:55.694090 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu May 26 15:01:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:56.576871 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-6fb1dee7-5d9f-4f34-88f0-5257f15c1fe7 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:56.577908 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-6fb1dee7-5d9f-4f34-88f0-5257f15c1fe7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 26 15:01:56.578490 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:56.770166 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-abccc8e8-b8c2-4b23-9512-3a60c7853600 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:56.776192 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-abccc8e8-b8c2-4b23-9512-3a60c7853600 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-abccc8e8-b8c2-4b23-9512-3a60c7853600 admin admin] Request method failure captured: May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Accept: application/json May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Connection: keep-alive May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Content-Length: 0 May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Host: 10.222.0.46 May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABij5ZkfPR_NyB26rcxlC_qjk0NP_7A50ST7RPED8UksY7RluwAOVVIYH-y8JWpuyyTIMu9dn3HhEzfGwdS1zFtzR3GRLn8IjQ-fMn_oJJ10hnoWW4NtxdEjKoe1KUEN3TfhGrzhZF7zIfB74AdiTQgD0uhor34nmYQYkH5r4NQdiE25Ts May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Domain-Id: None May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Domain-Name: None May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Project-Name: admin May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Role: admin,reader,member May 26 15:01:56.777821 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Roles: admin,reader,member May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_064fc3c7af494c988e44e426f21b1c78", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/064fc3c7af494c988e44e426f21b1c78"}]}] May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant: admin May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User: admin May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Id: dede0ef3af5b453796bce68732b5fd29 May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: X-User-Name: admin May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: method: > May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: exception: Flavor 451 could not be found. May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: action_args: {'id': '451'} May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:56.779387 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:56.780488 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi May 26 15:01:56.781957 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-abccc8e8-b8c2-4b23-9512-3a60c7853600 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:56.783254 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-abccc8e8-b8c2-4b23-9512-3a60c7853600 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062921 May 26 15:01:56.783254 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 15:01:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:56.789179 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a07595a8-b0df-4f63-a25a-b7aade7c602c admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:56.805059 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a07595a8-b0df-4f63-a25a-b7aade7c602c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019378 May 26 15:01:56.805646 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 15:01:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:01:56.816157 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:56.830255 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017649 May 26 15:01:56.830961 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu May 26 15:01:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:01:56.841071 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ab1b017c-4b2e-40ee-9b90-338d343ff516 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:56.846586 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-ab1b017c-4b2e-40ee-9b90-338d343ff516 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ab1b017c-4b2e-40ee-9b90-338d343ff516 admin admin] Request method failure captured: May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Accept: application/json May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Connection: keep-alive May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Content-Length: 0 May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Host: 10.222.0.46 May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABij5ZkfPR_NyB26rcxlC_qjk0NP_7A50ST7RPED8UksY7RluwAOVVIYH-y8JWpuyyTIMu9dn3HhEzfGwdS1zFtzR3GRLn8IjQ-fMn_oJJ10hnoWW4NtxdEjKoe1KUEN3TfhGrzhZF7zIfB74AdiTQgD0uhor34nmYQYkH5r4NQdiE25Ts May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Domain-Id: None May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Domain-Name: None May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Project-Name: admin May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Role: admin,reader,member May 26 15:01:56.848099 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Roles: admin,reader,member May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/064fc3c7af494c988e44e426f21b1c78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_064fc3c7af494c988e44e426f21b1c78", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/064fc3c7af494c988e44e426f21b1c78"}]}] May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant: admin May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 064fc3c7af494c988e44e426f21b1c78 May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User: admin May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Id: dede0ef3af5b453796bce68732b5fd29 May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: X-User-Name: admin May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: method: > May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: exception: Flavor 451 could not be found. May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: action_args: {'id': '451'} May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:01:56.849914 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:56.850825 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi May 26 15:01:56.851933 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ab1b017c-4b2e-40ee-9b90-338d343ff516 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:01:56.852980 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-ab1b017c-4b2e-40ee-9b90-338d343ff516 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012634 May 26 15:01:56.852980 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 15:01:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 15:01:57.732347 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:57.733372 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 26 15:01:57.733789 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:57.923871 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-b3d4f74b-18c6-412c-bf61-31dc74fe5581 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:57.944102 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-b3d4f74b-18c6-412c-bf61-31dc74fe5581 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073807 May 26 15:01:57.944656 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu May 26 15:01:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:58.824712 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:58.825754 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 26 15:01:58.826151 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:01:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:59.016399 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-27b16eb9-966f-4ce8-b649-931d251119a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:59.034826 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-27b16eb9-966f-4ce8-b649-931d251119a7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071914 May 26 15:01:59.035383 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu May 26 15:01:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:01:59.933707 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:59.934720 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 May 26 15:01:59.935115 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:01:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:02:00.128294 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-b784d2f9-d9a0-4f57-8473-cb4aff4f588f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:00.146570 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-b784d2f9-d9a0-4f57-8473-cb4aff4f588f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072859 May 26 15:02:00.147057 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu May 26 15:02:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:02:01.047108 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:01.048113 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 26 15:02:01.048528 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:02:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:02:01.239796 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-03068e7e-6b64-437a-b707-4eac18f035bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:01.260324 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-03068e7e-6b64-437a-b707-4eac18f035bb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074699 May 26 15:02:01.260829 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu May 26 15:02:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:02:02.148300 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:02.149305 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 26 15:02:02.149746 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:02:02.343687 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-20526247-bc2f-4706-a0ee-8900642bfbba admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:02.363073 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-20526247-bc2f-4706-a0ee-8900642bfbba admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073733 May 26 15:02:02.363536 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu May 26 15:02:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:03:05.198550 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:05.199561 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-c57c94cb-774d-45aa-b728-dc18c581c0c7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 26 15:03:05.199958 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Thu May 26 15:03:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:05.207246 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:03:05.260444 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-8e896bb1-6d05-4c3d-a9c6-18958b612ba7 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:05.279281 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-8e896bb1-6d05-4c3d-a9c6-18958b612ba7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073493 May 26 15:03:05.279813 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Thu May 26 15:03:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:03:05.300025 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=14 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:03:05.303971 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-102ad0c5-aea5-48d3-bf55-4ac33e5f1890 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:05.312015 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-102ad0c5-aea5-48d3-bf55-4ac33e5f1890 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013388 May 26 15:03:05.312541 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Thu May 26 15:03:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:05.324729 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-1558d931-a603-4f3c-a103-23946fe46d9b admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:05.332307 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-1558d931-a603-4f3c-a103-23946fe46d9b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011869 May 26 15:03:05.332834 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Thu May 26 15:03:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:05.344260 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:05.351755 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011153 May 26 15:03:05.352254 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Thu May 26 15:03:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:05.364663 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-feb154cb-a1d2-41bb-89af-f27ac8804270 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:05.372681 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-feb154cb-a1d2-41bb-89af-f27ac8804270 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011551 May 26 15:03:05.373189 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Thu May 26 15:03:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:06:42.339447 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:42.340464 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 May 26 15:06:42.340849 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:06:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:42.498693 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=6 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:42.616867 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-32ff58f0-44ce-40e2-bc13-0c5d864181d8 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:42.618105 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:42.618105 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: warnings.warn(msg) May 26 15:06:42.619365 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-32ff58f0-44ce-40e2-bc13-0c5d864181d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:42.619854 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-32ff58f0-44ce-40e2-bc13-0c5d864181d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:42.620637 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-32ff58f0-44ce-40e2-bc13-0c5d864181d8 admin admin] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:42.621065 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-32ff58f0-44ce-40e2-bc13-0c5d864181d8 admin admin] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:42.656434 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-32ff58f0-44ce-40e2-bc13-0c5d864181d8 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.159153 May 26 15:06:42.657017 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 15:06:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:06:43.547411 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:43.548433 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 26 15:06:43.548835 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:43.777052 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-85e30d76-8181-43ca-8cd2-90865a16a592 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:43.778468 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:43.778468 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: warnings.warn(msg) May 26 15:06:43.779672 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-85e30d76-8181-43ca-8cd2-90865a16a592 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:43.780108 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-85e30d76-8181-43ca-8cd2-90865a16a592 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:43.780889 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-85e30d76-8181-43ca-8cd2-90865a16a592 admin admin] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:43.781402 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-85e30d76-8181-43ca-8cd2-90865a16a592 admin admin] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:43.803017 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-85e30d76-8181-43ca-8cd2-90865a16a592 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.107991 May 26 15:06:43.803583 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 15:06:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:06:55.137731 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:55.138764 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 26 15:06:55.139160 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:06:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:55.283288 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:55.283999 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:55.284596 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=8 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:06:55.341729 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-97e57fe4-691a-4666-b337-2b41c036fff1 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:55.342900 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:55.342900 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: warnings.warn(msg) May 26 15:06:55.344087 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-97e57fe4-691a-4666-b337-2b41c036fff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:55.344528 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-97e57fe4-691a-4666-b337-2b41c036fff1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:55.345398 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-97e57fe4-691a-4666-b337-2b41c036fff1 admin admin] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:55.345810 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-97e57fe4-691a-4666-b337-2b41c036fff1 admin admin] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:55.372014 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-97e57fe4-691a-4666-b337-2b41c036fff1 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.093172 May 26 15:06:55.372577 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 15:06:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:06:56.268554 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:56.270156 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f68a9f25-662a-462d-9daf-4ae9ff1a8cdd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 26 15:06:56.270583 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Thu May 26 15:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:56.469261 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-f1f2e9e0-b69d-43a5-904d-49c6f0068aab admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:56.470604 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:56.470604 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: warnings.warn(msg) May 26 15:06:56.471832 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-f1f2e9e0-b69d-43a5-904d-49c6f0068aab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:56.472264 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-f1f2e9e0-b69d-43a5-904d-49c6f0068aab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:56.473417 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-f1f2e9e0-b69d-43a5-904d-49c6f0068aab admin admin] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:06:56.473958 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-f1f2e9e0-b69d-43a5-904d-49c6f0068aab admin admin] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:06:56.497657 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-f1f2e9e0-b69d-43a5-904d-49c6f0068aab admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084629 May 26 15:06:56.498238 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Thu May 26 15:06:56 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:07:55.686523 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: Thu May 26 15:07:55 2022 - graceful shutdown triggered... May 26 15:07:55.686634 dv-cinder-788367-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 15:07:55.688019 dv-cinder-788367-11-iscsi devstack@n-api.service[103272]: Gracefully killing worker 2 (pid: 103272)... May 26 15:07:55.688572 dv-cinder-788367-11-iscsi devstack@n-api.service[103271]: Gracefully killing worker 1 (pid: 103271)... May 26 15:07:56.689308 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: worker 1 buried after 1 seconds May 26 15:07:56.689308 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: worker 2 buried after 1 seconds May 26 15:07:56.689308 dv-cinder-788367-11-iscsi devstack@n-api.service[103270]: goodbye to uWSGI. May 26 15:07:56.691399 dv-cinder-788367-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 15:07:56.691978 dv-cinder-788367-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 15:07:56.694750 dv-cinder-788367-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 15:07:56.711146 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 15:07:56 2022] *** May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: nodename: dv-cinder-788367-11-iscsi May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: machine: x86_64 May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: clock source: unix May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: pcre jit disabled May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: detected number of CPU cores: 4 May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: current working directory: / May 26 15:07:56.726176 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: detected binary path: /usr/bin/uwsgi-core May 26 15:07:56.727170 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: your processes number limit is 47680 May 26 15:07:56.727170 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: your memory page size is 4096 bytes May 26 15:07:56.727170 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: detected max file descriptor number: 2048 May 26 15:07:56.727170 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: lock engine: pthread robust mutexes May 26 15:07:56.727170 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: thunder lock: enabled May 26 15:07:56.727170 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 15:07:56.727170 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 15:07:56.786105 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: Python main interpreter initialized at 0x5630b35689c0 May 26 15:07:56.786105 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: python threads support enabled May 26 15:07:56.786105 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: your server socket listen backlog is limited to 100 connections May 26 15:07:56.786105 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: your mercy for graceful operations on workers is 90 seconds May 26 15:07:56.786804 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: mapped 403077 bytes (393 KB) for 2 cores May 26 15:07:56.786804 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: *** Operational MODE: preforking *** May 26 15:07:56.787061 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: *** uWSGI is running in multiple interpreter mode *** May 26 15:07:56.787061 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: spawned uWSGI master process (pid: 117708) May 26 15:07:56.787097 dv-cinder-788367-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 15:07:56.793663 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: spawned uWSGI worker 1 (pid: 117723, cores: 1) May 26 15:07:56.793663 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: spawned uWSGI worker 2 (pid: 117724, cores: 1) May 26 15:07:56.793663 dv-cinder-788367-11-iscsi devstack@n-api.service[117708]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 15:07:58.036036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 15:07:58.059488 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 15:07:58.922596 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 15:07:58.922596 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: from cryptography.utils import int_from_bytes May 26 15:07:58.923070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 15:07:58.923070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: from cryptography.utils import int_from_bytes May 26 15:07:58.936292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 15:07:58.936292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: from cryptography.utils import int_from_bytes May 26 15:07:58.936786 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 15:07:58.936786 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: from cryptography.utils import int_from_bytes May 26 15:08:01.996650 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 15:08:01.997590 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 15:08:01.997590 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 15:08:01.997877 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 15:08:01.998107 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 15:08:01.998432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:01.998800 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:01.999115 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:01.999432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.000075 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.000393 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.000807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.001318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.001619 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.001839 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.002419 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.002759 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788367-11-iscsi {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.003103 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.003418 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.003733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.004064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.004375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.004702 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.005010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.005551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.006011 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.007181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.007181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.007181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.007564 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.007704 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.008014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.008311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.008640 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.008968 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.009383 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788367-11-iscsi {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.009717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.010036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.010344 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.010773 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.011089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.011400 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.011770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.012142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.012457 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.012795 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.013204 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.013438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.014701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.014701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.014701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.014701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.015066 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.015302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.015606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.015860 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.016170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.017131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.017345 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.017707 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.017955 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.018207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.018529 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.018853 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.019165 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.019473 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.019781 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.020089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.020399 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.020707 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.021016 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.021325 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.021901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.022224 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.022562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.022858 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.023182 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.023598 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.023850 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.024160 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.024512 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.024831 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.025147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.025526 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.025809 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.026117 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.026434 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.026742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.027064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.027412 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.027698 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.028210 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.028519 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.028870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.029154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.029479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.029787 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.030095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.030399 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.030733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.031076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.031408 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.031740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.031997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.032368 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.033556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.033556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.033556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.034002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.034002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.034254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.034562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.035039 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.035352 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.035680 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.035990 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.036301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.036675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.036980 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.037287 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.037761 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.038074 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.038386 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.038751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.039055 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.039362 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.039681 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.039990 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.040297 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.040602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.040907 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.041213 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.041587 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.041983 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.042293 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.042595 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.042922 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.043249 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.043563 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.043872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.044185 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.044506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.044850 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.045183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.045553 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.045874 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.046213 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.046613 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.046866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.047179 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.047494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.048369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.048687 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.049002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.049317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.049663 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.049984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.050318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.050639 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.050962 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.051283 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.051655 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.051929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.052248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.052577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.052891 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.053238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.053610 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.053930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.054257 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.054583 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.054901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.055214 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.055525 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.055854 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.056515 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.056515 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.065101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.065101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.065101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.065101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.065101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.065101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.065101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.065101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.070334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.070334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.070334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.070334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.070334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.070334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.070334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.070334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.071367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.071367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.071367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.071367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.071367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.071367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.071367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.071367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.072607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.072607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.072607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.072607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.072607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.072607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.072607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.072607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.074442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.074442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.074442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.074442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.074442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.074442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.074442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.074442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.075311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.075311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.075311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.075311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.075311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.075311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.075311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.075311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.076180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.076180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.076180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.076180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.076180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.076180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.076180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.076180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.077178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.077178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.077178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.077178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.077178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.077178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.077178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.077178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.078256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.078256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.078256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.078256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.078256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.078927 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.078927 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.079829 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.080178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.080298 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.080588 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.080901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.081217 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.081612 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.081865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.082188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.082556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.082819 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.083137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.083507 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.083826 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.084195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.084451 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.084763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.085204 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.085682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.085832 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.086093 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.086405 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.086721 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.087030 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.087342 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.087651 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.087963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.088283 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.088594 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.088956 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.089217 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.089563 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.089876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.090252 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.090496 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.090809 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.091141 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.091565 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.091878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.092188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.092686 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.092865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.093124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.093434 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.093762 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.094067 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.094379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.094753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.095561 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.095872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.096178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.096492 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.096809 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.097113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.097559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.097873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.098195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.098507 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.098832 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.099156 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.099461 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.099817 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.100141 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.100482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.100745 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.101048 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.101436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.101811 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.102125 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.102434 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.102893 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.103212 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.103527 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.103847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.104161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.104505 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.104796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.105114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.105484 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.105765 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.106077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.106389 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.106703 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.107030 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.107340 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.107652 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.107967 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.108273 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.108674 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.108999 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.109611 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.109945 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.110290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.110801 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.110970 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.111227 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.111559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.111883 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.112224 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.112532 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.112843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.113169 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.113441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.113772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.114080 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.114388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.114694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.115000 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.115312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.115617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.115919 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.116222 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.116535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.116839 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.117150 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.117480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.117797 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.118106 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.118411 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.118715 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.119017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.119431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.119769 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.120082 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.120414 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.120779 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.121065 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.121475 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.121811 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.122119 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.122427 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.122733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.123043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.123358 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.123641 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.123952 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.124261 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.124572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.125139 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.125482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.125778 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.126114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.126433 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.126745 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.127050 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.127352 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.127662 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.127971 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.128274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.128584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.128889 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.129205 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.129534 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.129916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.130137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.130444 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.130797 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.131058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.131536 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.131850 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.132157 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.132461 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.132770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.133076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.133414 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.133713 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.134097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.134355 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.134663 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.134971 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.135285 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.135590 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.135894 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.136202 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.136508 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.136812 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.137113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.138638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.138638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.138638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.138638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.139261 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.139261 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.139575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.139831 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.140118 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.140477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.140787 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.141155 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.141422 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.142324 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.142644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.142961 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.143276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.143630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.143883 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.144197 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.144502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.144810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.145131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.145468 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.145780 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.146101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.146454 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.146756 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.147063 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.147613 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.147779 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.148039 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.148349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.148737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.148968 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.149280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.149613 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.149931 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.150273 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.150541 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.150851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.151388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.151706 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.152039 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.152352 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.152659 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.152968 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.153274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.153750 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.153935 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.154339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.154651 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.154963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.155286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.155869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.156184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.156506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.156825 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.157157 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.158151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.158472 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.158845 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.159099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.159419 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.159839 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.160355 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.160731 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.161264 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.161816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.162352 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.162914 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.163375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.163946 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.164570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.165122 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.165805 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.166271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.166694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.167028 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.167366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.167703 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.168038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.168352 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.168791 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.169174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.169701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.170175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.170728 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.171231 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.171728 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.172251 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.172807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.173305 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.173816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.174511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.175046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.175503 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.175809 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.176165 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.176465 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.176781 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.177146 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.177487 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.177799 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.178131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.178441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.179286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.179701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.179977 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.180254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.180582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.181824 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.182041 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.182375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.182751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.183089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.183420 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.183734 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.184254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.184670 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.185153 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.185500 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.185821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.186179 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.186490 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.186819 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.187159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.187496 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.187811 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.188152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.188511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.188835 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.189245 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.189541 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.189857 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.190163 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.190475 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.190787 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.191097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.191402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.191715 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.192024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.192330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.192637 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.192963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.193269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.193612 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.193927 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.194278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.194541 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.194833 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.195180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.195579 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.195829 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.196154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.196546 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.196813 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.197126 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.197481 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.197795 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.198114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.198434 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.198821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.199145 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.199466 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.199782 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.200094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.200411 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.200728 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.201275 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.201703 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.202126 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.202354 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.202668 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.202984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.203304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.203661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.204639 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.204811 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.205127 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.205492 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.205802 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.206100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.206429 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.206766 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.207090 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.207404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.207720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.208036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.208398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.208713 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.209020 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.209556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.209792 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.210109 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.210423 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.210739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.211143 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.211455 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.211766 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.212081 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.212396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.212710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.213036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.213375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.213724 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.214040 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.214352 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.214849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.215320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.215636 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.216017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.216358 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.216688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.217015 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.217339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.217720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.217990 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.218297 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.218607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.218915 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.219223 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.219547 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.220432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.220740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.221074 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.221373 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.222236 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.222522 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.222675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.222953 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.223283 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.223605 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.223915 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.224241 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.224550 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.224966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.225172 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.225504 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.225814 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.226125 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.226467 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.226780 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.229688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.229688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.229688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.229688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.229688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.229688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.229688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.229688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.231087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.231087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.231087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.231087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.231087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.231087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.232396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.232396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.232396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.232396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.233111 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.233111 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.233483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.233483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.233774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.234087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.234395 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.234723 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.235175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.235378 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.235728 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.236046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.236631 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.236972 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.237296 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.237660 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.237996 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.238305 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.238612 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.238952 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.239247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.239562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.239871 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.240181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.240492 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.240905 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.241216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.241576 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.241860 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.242165 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.242490 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.242778 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.243077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.243387 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.243703 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.244049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.244370 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.244777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.245054 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.245406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.245682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.245959 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.246376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.246586 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.246957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.247238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.247555 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.247859 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.248294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.248609 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.248932 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.249254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.250053 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.250251 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.250578 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.250928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.251252 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.251566 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.251896 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.252234 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.252610 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.252900 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.253191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.253516 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.253824 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.254133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.254456 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.254768 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.255076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.255458 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.255689 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.256029 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.256345 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.256652 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.256966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.257278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.257618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.257929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.258299 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.258543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.258848 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.259156 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.259469 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.259777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.260085 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.260391 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.260825 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.261136 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.261492 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.261913 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.262149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.262476 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.262792 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.263117 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.263426 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.263749 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.264074 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.264396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.264709 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.265044 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.265357 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.265753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.265993 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.266304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.267164 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.267483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.267814 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.268142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.268448 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.268775 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.269094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.269420 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.269760 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.270076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.270499 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.270884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.271244 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.271521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.271836 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.272152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.272472 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.272972 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.273152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.273407 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.273788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.274119 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.274451 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.274806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.275120 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.275470 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.275822 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.276114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.276525 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.276730 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.276979 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 15:08:02.337701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO dbcounter [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Registered counter for database nova_api May 26 15:08:02.360878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_db.sqlalchemy.engines [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:08:02.369523 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writer thread running {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:08:02.376998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 15:08:02.377710 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 15:08:02.378421 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 15:08:02.379046 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 15:08:02.379480 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 15:08:02.380341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.380921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.381521 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.382090 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.382662 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.383190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.383729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.384241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.384785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.385223 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.385772 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.386407 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788367-11-iscsi {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.386998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.387556 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.388132 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.388703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.389245 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.389835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.390329 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.391153 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.392213 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.392716 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.393363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.393934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.394518 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.395074 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.395883 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.396469 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.397022 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.397631 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.398410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788367-11-iscsi {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.398956 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.399458 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.399962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.400688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.401232 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.401808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.402389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.402958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.403504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.404070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.404640 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.405200 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.405830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.406454 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.407024 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.407571 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.408146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.408761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.409292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.409744 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.410261 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.410832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.411409 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.412211 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.412635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.413045 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.413590 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.414105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.414601 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.415159 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.415688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.416362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.416716 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.417244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.417941 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.418514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.418998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.419486 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.420083 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.420598 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.421034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.421928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.422290 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.422802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.423284 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.423688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.424137 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.424547 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.425017 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.425507 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.425935 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.426366 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.426841 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.427395 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.427789 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.428163 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.428583 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.429100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.430434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.430434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.430434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.430820 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.431022 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.context [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6457610-a8a6-401c-aab2-670bbc3dd86d(cell1) {{(pid=117724) load_cells /opt/stack/nova/nova/context.py:464}} May 26 15:08:02.431261 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.431686 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.432116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.432542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.432962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.433381 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.433822 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.434240 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.434668 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.435105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.435290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:02.435612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.436049 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.436473 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.436777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:02.436980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.437577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.437752 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:02.438169 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.439260 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.439796 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.440144 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:02.440343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.440880 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.441417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.441983 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.442201 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO dbcounter [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Registered counter for database nova_cell0 May 26 15:08:02.442744 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.443281 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.443805 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.444366 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.445525 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.445525 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.446092 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.446518 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.446733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO dbcounter [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Registered counter for database nova_cell1 May 26 15:08:02.447115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.447502 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.447922 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.448344 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.448838 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.449371 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.450919 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.450919 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.450919 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.451494 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.452121 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.452617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.453167 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.453785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 15:08:02.455121 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.455695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.456340 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.456870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.457329 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_db.sqlalchemy.engines [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:08:02.457649 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.458155 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.458540 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.458908 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_db.sqlalchemy.engines [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:08:02.459160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.459590 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.460052 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.460508 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.461048 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.461734 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.462180 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.462614 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.463059 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.463496 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.463926 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.464364 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.464793 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.465219 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.465726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.466244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.466884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.467307 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.467845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.468273 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.468710 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.469142 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.469605 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writer thread running {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:08:02.469783 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.470133 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.470553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.471014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.471455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.471674 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writer thread running {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:08:02.471965 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.472391 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.472898 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.473320 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.473784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.474216 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.474635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.475079 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.475505 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.475926 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.476357 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.476890 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.477375 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.477838 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.478265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.478683 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.479157 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.479577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.480235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.480655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.481086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.481584 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.482014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.482456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.482873 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.483293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.483720 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.484146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.484568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.484989 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.485441 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.485896 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.486326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.486784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.487359 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.487735 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.488149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.488562 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.488993 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.489428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.490001 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.490422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.490841 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.491275 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.491707 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.492124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.492561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.493005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.493416 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.493905 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.494362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.494791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.495211 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.495629 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.496041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.496460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.496883 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.497555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.497877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.498294 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.498714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.499160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.499582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.500282 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.500727 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.501710 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.502152 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.502581 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.503042 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.503456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.503908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.504350 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.504782 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.505226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.505708 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.506132 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.506558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.506976 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.507458 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.507914 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.508354 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.508779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.509253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.509828 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.510272 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.510729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.511163 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.511574 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.511998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.512443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.512887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.513366 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.513857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.514276 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.514704 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.515128 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.515555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.515980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.516405 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.517416 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.517878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.518308 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.518741 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.519180 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.519630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.520086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.520530 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.520979 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.521426 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.521890 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.522317 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.522769 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.523198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.523621 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.524051 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.524470 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.524880 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.525292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.525738 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.526178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.526603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.527021 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.527494 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.527990 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.528417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.528841 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.529264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.529825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.530263 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.530710 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.531160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.531604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.532017 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.532462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.532927 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.533374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.533844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.534267 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.534680 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.535140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.535557 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.535976 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.536438 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.536870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.537292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.537757 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.538213 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.538632 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.539080 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.539788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.540140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.540562 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.540987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.541432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.541893 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.542325 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.542742 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.543160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.543586 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.544005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.544431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.544856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.545590 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.546028 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.546450 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.546886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.547320 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.547779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.548215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.548657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.549104 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.549565 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.550057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.550471 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.550884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.551364 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.551777 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.552198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.552611 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.553032 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.553478 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.553902 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.554321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.554733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.555190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.555638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.556081 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.556495 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.556936 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.557354 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.557794 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.558206 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.558630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.559097 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.559620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.560132 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.560565 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.561017 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.561507 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.561884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.562278 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.562700 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.563121 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.564064 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.564489 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.564912 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.565322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.565764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.566183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.566610 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.567026 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.567441 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.567855 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.568265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.568685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.569240 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.569699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.570144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.570580 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.570997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.571413 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.571838 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.572246 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.572675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.573086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.573535 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.573963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.574386 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.574802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.575219 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.575656 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.576081 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.576506 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.576914 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.577330 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.577792 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.578201 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.578653 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.579723 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.580155 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.580598 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.581019 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.581602 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.581952 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.582373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.582793 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.583213 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.583659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.584073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.584493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.584904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.585339 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.585791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.586207 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.586630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.587051 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.587538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.587964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.588432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.588852 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.589401 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.589872 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.590291 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.590711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.591130 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.591925 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.592351 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.592822 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.593292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.593764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.594189 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.594678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.595099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.595526 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.595957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.596390 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.596827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.597251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.597731 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.598161 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.598614 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.599119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.599582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.600011 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.600442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.600864 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.601285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.601740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.602247 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.602676 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.603105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.603525 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.604012 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.604493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.604929 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.605396 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.605888 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.606414 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.606894 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.607586 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.608081 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.608567 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.609041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.609668 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.610208 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.610804 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.611378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.611938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.612723 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.613308 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.613911 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.614355 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.614754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.615151 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.615551 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.615963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.616363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.616755 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.617142 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.617608 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.617996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.618454 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.619107 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.619625 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.620099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.620710 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.621182 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.621728 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.622245 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.622750 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.623258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.623741 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.624241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.624996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.625555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.626666 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.627247 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.627819 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.628382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.628980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.629681 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.630265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.630879 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.632187 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.632187 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.632498 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.632912 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.633320 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.633738 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.634141 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.634603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.635036 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.635571 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.636127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.636643 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.637171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.637745 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.638287 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.638825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.639582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.640146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.640629 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.641217 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.642218 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.642630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.643036 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.643435 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.643845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.644249 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.644700 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.645143 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.645613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.646073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.646491 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.646924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.647399 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.647876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.648297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.648743 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.649308 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.649768 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.650218 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.650658 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.651080 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.651497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.651922 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.652338 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.652764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.653180 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.653641 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.654066 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.654479 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.654904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.655334 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.655749 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.656190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.656610 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.657023 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.657498 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.657917 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.658373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.658790 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.659239 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.659668 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.660114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.660552 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.661005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.661491 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.661934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.662366 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.662802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.663254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.663678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.664103 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.664533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.664959 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.665389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.665845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.666275 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.666947 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.667385 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.667816 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.668240 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.668694 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.669225 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.669695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.670150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.670582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.671004 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.671426 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.671858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.672426 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.673034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.673533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.673916 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.674294 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.674675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.675104 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.675582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.676006 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.676424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.676848 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.677276 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.677741 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.678173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.678601 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.679126 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.679595 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.680164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.680730 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.681170 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.681606 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.682015 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.682443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.682847 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.683307 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.683712 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.684141 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.684809 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.685238 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.685716 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.686164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.686601 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.687036 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.687461 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.687899 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.688847 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.689274 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.689737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.690157 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.690576 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.691004 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.691478 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.691898 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.692326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.692742 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.693485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.693932 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.694370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.694803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.695270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.695720 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.696143 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.696684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.697202 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.697751 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.698290 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.698818 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.700128 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.700128 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.700370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.700916 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.701606 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.702071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.702618 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.703119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.703644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.704725 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.705157 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.705716 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.706147 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.706578 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.706999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.707416 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.707844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.708260 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.708681 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.709237 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.709698 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.710140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.710575 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.711037 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.711588 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.712014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.712432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.712862 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.713284 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.713811 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.714245 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.714700 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.715063 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO dbcounter [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Registered counter for database nova_cell0 May 26 15:08:02.715293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.715683 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.716401 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.716851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.717282 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.717754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.718207 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.718742 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.719150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.719636 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.720155 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.720592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.721013 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.721469 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.721915 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.722347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.722775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.723200 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.723622 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.724121 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.724551 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.724944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_db.sqlalchemy.engines [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:08:02.725202 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.725636 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.726061 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.726490 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.726958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.727444 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.727849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.728297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.728678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.729251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.729765 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.730257 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.730675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.731038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.731613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.731891 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writer thread running {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:08:02.732194 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.732633 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.733310 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.733772 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.734280 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.734713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.735148 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.736194 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.736638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.737151 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.737624 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.738059 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.738507 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.738962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.739409 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.739845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.740267 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.740698 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.741113 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.741564 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.742001 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.742423 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.742844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.743348 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.743770 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.744190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.744644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.745034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.745403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.745832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.746289 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.746679 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.747067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.747527 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.748136 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.748459 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.748989 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.749395 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.750080 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.750471 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.750921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.751941 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.752555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.753053 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.753614 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.754210 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.754799 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.755363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.757888 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.759106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.759639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.760244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.760795 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.761378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.761803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.762146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.762496 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.762967 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.763405 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.763862 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.764306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.764746 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.765195 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.765818 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.766255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.766741 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.767219 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.767655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.768108 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.768547 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.768974 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.769409 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.769865 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.770300 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.770785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.771221 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.771670 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.772111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.772534 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.772985 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.773437 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.773957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.774384 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.774846 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.775313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.775791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.776230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.776653 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 15:08:02.776996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 15:08:02.843254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO dbcounter [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Registered counter for database nova_api May 26 15:08:02.867021 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_db.sqlalchemy.engines [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:08:02.877579 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writer thread running {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:08:02.954815 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.context [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6457610-a8a6-401c-aab2-670bbc3dd86d(cell1) {{(pid=117723) load_cells /opt/stack/nova/nova/context.py:464}} May 26 15:08:02.961219 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:02.963118 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:02.963955 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:02.965997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:02.968036 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO dbcounter [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Registered counter for database nova_cell0 May 26 15:08:02.972706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO dbcounter [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Registered counter for database nova_cell1 May 26 15:08:02.980119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_db.sqlalchemy.engines [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:08:02.983352 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_db.sqlalchemy.engines [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:08:02.990552 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writer thread running {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:08:02.991924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writer thread running {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:08:03.174259 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO dbcounter [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Registered counter for database nova_cell0 May 26 15:08:03.184270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_db.sqlalchemy.engines [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 15:08:03.190492 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writer thread running {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 15:08:03.283803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: WARNING keystonemiddleware.auth_token [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 15:08:03.295920 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: WARNING keystonemiddleware.auth_token [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 15:08:03.540548 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: WARNING keystonemiddleware.auth_token [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 15:08:03.548559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: WARNING keystonemiddleware.auth_token [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 15:08:03.762087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: WARNING keystonemiddleware.auth_token [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 15:08:03.768275 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: WARNING keystonemiddleware.auth_token [None req-440d3622-8893-4c2c-8b7d-b24b9636c7ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 15:08:03.776444 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5630b35689c0 pid: 117724 (default app) May 26 15:08:04.018370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: WARNING keystonemiddleware.auth_token [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 15:08:04.024599 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: WARNING keystonemiddleware.auth_token [None req-b88e403a-f2bc-42ee-8492-953a9d41d4c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 15:08:04.030322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5630b35689c0 pid: 117723 (default app) May 26 15:08:46.967242 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:46.968202 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:46.968838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:46.970330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:47.993176 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7ded69f0-b3fa-4cfd-8c96-48bf997dc96f tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Action: 'create', calling method: .version_select at 0x7ff96803cca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1741096216"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:48.272137 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:48.274007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:48.275588 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:48.277057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:08:49.871969 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-789431be-d06d-48cb-bffc-737e2a173580 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Action: 'create', calling method: .version_select at 0x7ff96803dc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-918976109", "metadata": {"Type": "work"}}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-789431be-d06d-48cb-bffc-737e2a173580 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Request method failure captured: May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 121 May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gA7UWE8XJ0RHL-V5A1JwLFrglKc5sAqqasS5mVw-A5IYXtXrDesZxas8YtAw1jCb1z1fRoUnjk5HjeyHec4eTuoFw0VW5J5pPv7ubuc29yFX0e6JeKEA23r5v6r5Ttu5L3i2SYqp-IQKfpneIRYr5L3kN2FuGiVK9bSez3AsfmaVQ May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:08:49.895779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_612679bca8894138b317a0c19d8b2069", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/612679bca8894138b317a0c19d8b2069"}]}] May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: ff29b1cfe4c945a7a7aca87b79fc8075 May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-918976109", "metadata": {"Type": "work"}}} May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: May 26 15:08:49.898227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-918976109', 'metadata': {'Type': 'work'}}}} May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise error May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi '#$%' May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:49.899559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 15:08:49.902215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 15:08:49.906073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 15:08:49.906073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.907566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-789431be-d06d-48cb-bffc-737e2a173580 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:49.909097 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-789431be-d06d-48cb-bffc-737e2a173580 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.648952 May 26 15:08:49.915100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Thu May 26 15:08:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1656 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:08:49.928555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0eb6cbe3-ab75-4bcc-8a5a-8ba2f7717c93 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Action: 'create', calling method: .version_select at 0x7ff967f35ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-911300033", "metadata": {"Type": "work"}}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0eb6cbe3-ab75-4bcc-8a5a-8ba2f7717c93 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Request method failure captured: May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 119 May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gA7UWE8XJ0RHL-V5A1JwLFrglKc5sAqqasS5mVw-A5IYXtXrDesZxas8YtAw1jCb1z1fRoUnjk5HjeyHec4eTuoFw0VW5J5pPv7ubuc29yFX0e6JeKEA23r5v6r5Ttu5L3i2SYqp-IQKfpneIRYr5L3kN2FuGiVK9bSez3AsfmaVQ May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:08:49.933264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_612679bca8894138b317a0c19d8b2069", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/612679bca8894138b317a0c19d8b2069"}]}] May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: ff29b1cfe4c945a7a7aca87b79fc8075 May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-911300033", "metadata": {"Type": "work"}}} May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: May 26 15:08:49.934934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-911300033', 'metadata': {'Type': 'work'}}}} May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise error May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi '0' May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:49.935761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 15:08:49.937362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 15:08:49.938706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 15:08:49.938706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.942286 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0eb6cbe3-ab75-4bcc-8a5a-8ba2f7717c93 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:49.943801 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0eb6cbe3-ab75-4bcc-8a5a-8ba2f7717c93 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027191 May 26 15:08:49.956541 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 2/2] 10.222.0.46 () {60 vars in 1155 bytes} [Thu May 26 15:08:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:08:49.970290 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-69aba192-39c6-479f-ace7-47809aae1616 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Action: 'create', calling method: .version_select at 0x7ff967f350d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1666905314", "metadata": {"Type": "work"}}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-69aba192-39c6-479f-ace7-47809aae1616 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Request method failure captured: May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 119 May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gA7UWE8XJ0RHL-V5A1JwLFrglKc5sAqqasS5mVw-A5IYXtXrDesZxas8YtAw1jCb1z1fRoUnjk5HjeyHec4eTuoFw0VW5J5pPv7ubuc29yFX0e6JeKEA23r5v6r5Ttu5L3i2SYqp-IQKfpneIRYr5L3kN2FuGiVK9bSez3AsfmaVQ May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:08:49.980099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_612679bca8894138b317a0c19d8b2069", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/612679bca8894138b317a0c19d8b2069"}]}] May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: ff29b1cfe4c945a7a7aca87b79fc8075 May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1666905314", "metadata": {"Type": "work"}}} May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: May 26 15:08:49.981733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1666905314', 'metadata': {'Type': 'work'}}}} May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise error May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi '' May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:49.982675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 15:08:49.984228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 15:08:49.985493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 15:08:49.985493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:49.985493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-69aba192-39c6-479f-ace7-47809aae1616 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:49.986273 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-69aba192-39c6-479f-ace7-47809aae1616 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025955 May 26 15:08:49.987937 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 3/3] 10.222.0.46 () {60 vars in 1155 bytes} [Thu May 26 15:08:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:08:50.000650 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0a8bd633-9bb0-47dd-bace-bf6a7a34a8a3 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Calling method '.version_select at 0x7ff967eedc10>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:50.833293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-0a8bd633-9bb0-47dd-bace-bf6a7a34a8a3 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] HTTP exception thrown: Volume tempest-invalid-1055251651 could not be found. May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0a8bd633-9bb0-47dd-bace-bf6a7a34a8a3 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Request method failure captured: May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1055251651 HTTP/1.1 May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gA7UWE8XJ0RHL-V5A1JwLFrglKc5sAqqasS5mVw-A5IYXtXrDesZxas8YtAw1jCb1z1fRoUnjk5HjeyHec4eTuoFw0VW5J5pPv7ubuc29yFX0e6JeKEA23r5v6r5Ttu5L3i2SYqp-IQKfpneIRYr5L3kN2FuGiVK9bSez3AsfmaVQ May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:08:50.848293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_612679bca8894138b317a0c19d8b2069", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/612679bca8894138b317a0c19d8b2069"}]}] May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesNegativeTest-2014174828 May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: ff29b1cfe4c945a7a7aca87b79fc8075 May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Volume tempest-invalid-1055251651 could not be found. May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': 'tempest-invalid-1055251651'} May 26 15:08:50.849851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1055251651 could not be found. (HTTP 404) (Request-ID: req-cdefe2fd-61a8-47bb-b2a1-60c21d574db7) May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:50.851086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:08:50.853072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1055251651 could not be found. May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:50.854510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1055251651 could not be found. May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1055251651 could not be found. May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0a8bd633-9bb0-47dd-bace-bf6a7a34a8a3 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Returning 404 to user: Volume tempest-invalid-1055251651 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0a8bd633-9bb0-47dd-bace-bf6a7a34a8a3 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1055251651" status: 404 len: 99 microversion: 2.1 time: 0.856396 May 26 15:08:50.855748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 4/4] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 15:08:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1055251651 => generated 99 bytes in 861 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 15:08:50.879421 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-71af9e6f-e762-4897-af4c-faf10e65f48b tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015623 May 26 15:08:50.880083 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1139 bytes} [Thu May 26 15:08:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 15:08:50.904447 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d8e2efd2-0a3f-4235-b39f-90ee1233dd57 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017503 May 26 15:08:50.909402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1136 bytes} [Thu May 26 15:08:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 15:08:50.928024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7ded69f0-b3fa-4cfd-8c96-48bf997dc96f tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.967805 May 26 15:08:50.931308 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 1/7] 10.222.0.46 () {60 vars in 1154 bytes} [Thu May 26 15:08:46 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3982 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 15:08:50.944895 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e7c20cbe-83ec-4484-ad03-9fdd34d54a06 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Calling method '.version_select at 0x7ff967e8ac10>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:51.023938 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-e7c20cbe-83ec-4484-ad03-9fdd34d54a06 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] HTTP exception thrown: Volume 99ee4528-0878-435a-83f0-c9f54867a26e could not be found. May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e7c20cbe-83ec-4484-ad03-9fdd34d54a06 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Request method failure captured: May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: DELETE /compute/v2.1/os-volumes/99ee4528-0878-435a-83f0-c9f54867a26e HTTP/1.1 May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gA7UWE8XJ0RHL-V5A1JwLFrglKc5sAqqasS5mVw-A5IYXtXrDesZxas8YtAw1jCb1z1fRoUnjk5HjeyHec4eTuoFw0VW5J5pPv7ubuc29yFX0e6JeKEA23r5v6r5Ttu5L3i2SYqp-IQKfpneIRYr5L3kN2FuGiVK9bSez3AsfmaVQ May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:08:51.030948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_612679bca8894138b317a0c19d8b2069", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/612679bca8894138b317a0c19d8b2069"}]}] May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesNegativeTest-2014174828 May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: ff29b1cfe4c945a7a7aca87b79fc8075 May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Volume 99ee4528-0878-435a-83f0-c9f54867a26e could not be found. May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '99ee4528-0878-435a-83f0-c9f54867a26e'} May 26 15:08:51.032488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 99ee4528-0878-435a-83f0-c9f54867a26e could not be found. (HTTP 404) (Request-ID: req-280e3994-9161-4f0f-9bb5-ca768c662b50) May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.033501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:08:51.034903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 99ee4528-0878-435a-83f0-c9f54867a26e could not be found. May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 15:08:51.036294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 99ee4528-0878-435a-83f0-c9f54867a26e could not be found. May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 99ee4528-0878-435a-83f0-c9f54867a26e could not be found. May 26 15:08:51.037777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.041693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e7c20cbe-83ec-4484-ad03-9fdd34d54a06 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Returning 404 to user: Volume 99ee4528-0878-435a-83f0-c9f54867a26e could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:51.041693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e7c20cbe-83ec-4484-ad03-9fdd34d54a06 tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/99ee4528-0878-435a-83f0-c9f54867a26e" status: 404 len: 109 microversion: 2.1 time: 0.106595 May 26 15:08:51.041693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 2/8] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:08:50 2022] DELETE /compute/v2.1/os-volumes/99ee4528-0878-435a-83f0-c9f54867a26e => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:08:51.063560 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9e24c0c4-08e0-4c0b-b49f-b96ffa7795da tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967e03430>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:51.081486 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1982751292", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "networks": [{"uuid": "d6e67ec8-e436-41ad-87a9-abca58e8da75"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:51.182059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9e24c0c4-08e0-4c0b-b49f-b96ffa7795da tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722" status: 200 len: 345 microversion: 2.1 time: 0.135306 May 26 15:08:51.183479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 3/9] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:08:51 2022] GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:51.191292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5c151f0d-d52b-4eec-9bb7-cc67ee58973b tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Calling method '.version_select at 0x7ff967e8ad30>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:51.269643 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-5c151f0d-d52b-4eec-9bb7-cc67ee58973b tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] HTTP exception thrown: Volume 9df0a85a-989b-43e8-8abf-ffa9278f734a could not be found. May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5c151f0d-d52b-4eec-9bb7-cc67ee58973b tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Request method failure captured: May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/os-volumes/9df0a85a-989b-43e8-8abf-ffa9278f734a HTTP/1.1 May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gA7UWE8XJ0RHL-V5A1JwLFrglKc5sAqqasS5mVw-A5IYXtXrDesZxas8YtAw1jCb1z1fRoUnjk5HjeyHec4eTuoFw0VW5J5pPv7ubuc29yFX0e6JeKEA23r5v6r5Ttu5L3i2SYqp-IQKfpneIRYr5L3kN2FuGiVK9bSez3AsfmaVQ May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:08:51.276602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/612679bca8894138b317a0c19d8b2069"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_612679bca8894138b317a0c19d8b2069", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/612679bca8894138b317a0c19d8b2069"}]}] May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesNegativeTest-2014174828 May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 612679bca8894138b317a0c19d8b2069 May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesNegativeTest-2014174828 May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: ff29b1cfe4c945a7a7aca87b79fc8075 May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesNegativeTest-2014174828-project May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Volume 9df0a85a-989b-43e8-8abf-ffa9278f734a could not be found. May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '9df0a85a-989b-43e8-8abf-ffa9278f734a'} May 26 15:08:51.278746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9df0a85a-989b-43e8-8abf-ffa9278f734a could not be found. (HTTP 404) (Request-ID: req-cff0401b-415a-411c-8148-18066e7864c7) May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.279665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:51.281221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9df0a85a-989b-43e8-8abf-ffa9278f734a could not be found. May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 15:08:51.282617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9df0a85a-989b-43e8-8abf-ffa9278f734a could not be found. May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9df0a85a-989b-43e8-8abf-ffa9278f734a could not be found. May 26 15:08:51.284443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:51.287361 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5c151f0d-d52b-4eec-9bb7-cc67ee58973b tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] Returning 404 to user: Volume 9df0a85a-989b-43e8-8abf-ffa9278f734a could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:51.290277 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5c151f0d-d52b-4eec-9bb7-cc67ee58973b tempest-VolumesNegativeTest-2014174828 tempest-VolumesNegativeTest-2014174828-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/9df0a85a-989b-43e8-8abf-ffa9278f734a" status: 404 len: 109 microversion: 2.1 time: 0.105441 May 26 15:08:51.293230 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 4/10] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:08:51 2022] GET /compute/v2.1/os-volumes/9df0a85a-989b-43e8-8abf-ffa9278f734a => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:08:51.423667 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] validate_networks() for [('d6e67ec8-e436-41ad-87a9-abca58e8da75', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:08:52.200898 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a329e54b-882a-4043-b7f7-e0a8950425fd tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967e03ca0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:52.275239 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a329e54b-882a-4043-b7f7-e0a8950425fd tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722" status: 200 len: 346 microversion: 2.1 time: 0.081192 May 26 15:08:52.284192 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 5/11] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:08:52 2022] GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:52.291150 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c819f920-53b9-48af-94a7-7ca2f578df3b tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Action: 'create', calling method: .version_select at 0x7ff967e03940>, body: {"snapshot": {"volume_id": "767c7173-a6f9-4776-9651-202629bb3722", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1476749501"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:53.083183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c819f920-53b9-48af-94a7-7ca2f578df3b tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.796360 May 26 15:08:53.086198 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 6/12] 10.222.0.46 () {60 vars in 1161 bytes} [Thu May 26 15:08:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:08:53.102127 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-009da8e7-7276-4b39-ba14-7fbc781d95c9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff96881f0d0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:53.281575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-009da8e7-7276-4b39-ba14-7fbc781d95c9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653" status: 200 len: 287 microversion: 2.1 time: 0.183939 May 26 15:08:53.292619 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 15:08:53 2022] GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 => generated 287 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:53.300135 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-95c71e32-406d-4a70-aaf1-2b76e31a1f11 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967e12310>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:53.388161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-95c71e32-406d-4a70-aaf1-2b76e31a1f11 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.093584 May 26 15:08:53.389218 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 8/14] 10.222.0.46 () {58 vars in 1139 bytes} [Thu May 26 15:08:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:53.406948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-98d3e173-5d65-4b9e-878c-3338d4e79237 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967e030d0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:53.473539 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-98d3e173-5d65-4b9e-878c-3338d4e79237 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653" status: 200 len: 287 microversion: 2.1 time: 0.074024 May 26 15:08:53.475233 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 9/15] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 15:08:53 2022] GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:54.488524 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-eb609ae5-7887-411f-a787-29ef44df4847 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967e03a60>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:54.582321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-eb609ae5-7887-411f-a787-29ef44df4847 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653" status: 200 len: 287 microversion: 2.1 time: 0.098082 May 26 15:08:54.583694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 10/16] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 15:08:54 2022] GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:08:55.000847 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:08:55.003610 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:08:55.004522 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:08:55.007863 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:08:55.008497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:08:55.066769 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:55.067224 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:55.068014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:55.068444 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:55.150715 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Getting quotas for project ac537167367948ef88587242df4e921d. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:08:55.167872 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Getting quotas for user 166bfe89e44847d7b380f33e2e28401d and project ac537167367948ef88587242df4e921d. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:08:55.198100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:08:55.207404 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:08:55.399217 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6ba14074-d790-4f64-a49d-99f4ea3a2e20 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.486123 May 26 15:08:55.403953 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 7/17] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:08:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 4494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:08:55.415916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7b663142-e177-4ebe-96c2-20df27c9c319 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:55.416680 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7b663142-e177-4ebe-96c2-20df27c9c319 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:55.600322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7a088101-bf4d-4bd3-9927-03a9b8dac081 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967521c10>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:55.727497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7a088101-bf4d-4bd3-9927-03a9b8dac081 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653" status: 200 len: 287 microversion: 2.1 time: 0.132257 May 26 15:08:55.731231 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 8/18] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 15:08:55 2022] GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:56.130564 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7b663142-e177-4ebe-96c2-20df27c9c319 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:56.175702 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7b663142-e177-4ebe-96c2-20df27c9c319 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1215 microversion: 2.1 time: 0.763549 May 26 15:08:56.188798 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 11/19] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:08:55 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1215 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:56.745057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d8d909aa-1eb6-45fd-b80c-6f9482554f0a tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff9675383a0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:56.832939 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d8d909aa-1eb6-45fd-b80c-6f9482554f0a tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653" status: 200 len: 288 microversion: 2.1 time: 0.092938 May 26 15:08:56.833561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 9/20] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 15:08:56 2022] GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 => generated 288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:56.846221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9b3a2190-d8ec-40ae-a575-e2d2358217df tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967e12b80>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:57.008770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9b3a2190-d8ec-40ae-a575-e2d2358217df tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653" status: 202 len: 0 microversion: 2.1 time: 0.168131 May 26 15:08:57.009359 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 12/21] 10.222.0.46 () {58 vars in 1253 bytes} [Thu May 26 15:08:56 2022] DELETE /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:08:57.018174 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0cacee6d-16de-4873-9e51-d0454dbe85f9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967521e50>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:57.079706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0cacee6d-16de-4873-9e51-d0454dbe85f9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653" status: 200 len: 287 microversion: 2.1 time: 0.065685 May 26 15:08:57.080545 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 10/22] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 15:08:57 2022] GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:57.196664 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3430f030-3aed-4155-9780-ecab05485105 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:57.199811 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3430f030-3aed-4155-9780-ecab05485105 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:57.375226 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3430f030-3aed-4155-9780-ecab05485105 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:57.384964 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3430f030-3aed-4155-9780-ecab05485105 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1215 microversion: 2.1 time: 0.192365 May 26 15:08:57.400268 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 13/23] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:08:57 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:58.093566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-89c1298c-e974-4007-8459-b41ff331afa9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967521820>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:58.150870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-89c1298c-e974-4007-8459-b41ff331afa9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] HTTP exception thrown: Snapshot 36acf735-eedf-4d0e-81bc-33bfa08aa653 could not be found. May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-89c1298c-e974-4007-8459-b41ff331afa9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Request method failure captured: May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 HTTP/1.1 May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5f-E76YkKoi3mMT-m9Xahh617Q1LHl2gEiATP4GntasttjW2qw7TWrZa5tVZXjxABmqtPEh4KSjldPl3DPabA-MyibdkbYBys3VqnBCKUrQZSTpx5sF9j7jKMBdb2fo_jROq2r-gPuQa3f6TLZlNCoK3lrscZ83-i1nP4TtVxq73XA May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 595a3d59c45f452d935dcec7a8938828 May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:08:58.152982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/595a3d59c45f452d935dcec7a8938828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/595a3d59c45f452d935dcec7a8938828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_595a3d59c45f452d935dcec7a8938828", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/595a3d59c45f452d935dcec7a8938828"}]}] May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 595a3d59c45f452d935dcec7a8938828 May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesSnapshotsTestJSON-321559047-project May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: eb0888d2b5024d558d15fe47e2d34ccb May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321559047-project May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Snapshot 36acf735-eedf-4d0e-81bc-33bfa08aa653 could not be found. May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '36acf735-eedf-4d0e-81bc-33bfa08aa653'} May 26 15:08:58.154412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 36acf735-eedf-4d0e-81bc-33bfa08aa653 could not be found. (HTTP 404) (Request-ID: req-dbba8f12-a0f8-480a-98a8-dde2553eb614) May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:58.155114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:58.156515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 36acf735-eedf-4d0e-81bc-33bfa08aa653 could not be found. May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 15:08:58.157433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 36acf735-eedf-4d0e-81bc-33bfa08aa653 could not be found. May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 36acf735-eedf-4d0e-81bc-33bfa08aa653 could not be found. May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-89c1298c-e974-4007-8459-b41ff331afa9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Returning 404 to user: Snapshot 36acf735-eedf-4d0e-81bc-33bfa08aa653 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-89c1298c-e974-4007-8459-b41ff331afa9 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653" status: 404 len: 111 microversion: 2.1 time: 0.066726 May 26 15:08:58.159800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 11/24] 10.222.0.46 () {58 vars in 1250 bytes} [Thu May 26 15:08:58 2022] GET /compute/v2.1/os-snapshots/36acf735-eedf-4d0e-81bc-33bfa08aa653 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:08:58.166651 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9bb72d0a-bced-4922-a8af-071bd913bd1b tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967dc9f70>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:58.339777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9bb72d0a-bced-4922-a8af-071bd913bd1b tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722" status: 202 len: 0 microversion: 2.1 time: 0.179443 May 26 15:08:58.341128 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 14/25] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:08:58 2022] DELETE /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:08:58.360578 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b80a3b73-0228-4931-88d7-7459802f8372 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967e0b790>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:58.412190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9ae4a0e6-468f-47b6-9e3a-14a59aa1a886 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:58.413430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9ae4a0e6-468f-47b6-9e3a-14a59aa1a886 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:58.464644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b80a3b73-0228-4931-88d7-7459802f8372 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722" status: 200 len: 345 microversion: 2.1 time: 0.117132 May 26 15:08:58.465949 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 12/26] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:08:58 2022] GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:58.652175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9ae4a0e6-468f-47b6-9e3a-14a59aa1a886 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:58.675273 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9ae4a0e6-468f-47b6-9e3a-14a59aa1a886 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1215 microversion: 2.1 time: 0.266240 May 26 15:08:58.697027 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 15/27] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:08:58 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:08:59.489158 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-eac2b1ff-7ec0-4e69-823e-f23c24e1ad41 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967538940>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:59.572877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-eac2b1ff-7ec0-4e69-823e-f23c24e1ad41 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] HTTP exception thrown: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-eac2b1ff-7ec0-4e69-823e-f23c24e1ad41 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Request method failure captured: May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 HTTP/1.1 May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5f-E76YkKoi3mMT-m9Xahh617Q1LHl2gEiATP4GntasttjW2qw7TWrZa5tVZXjxABmqtPEh4KSjldPl3DPabA-MyibdkbYBys3VqnBCKUrQZSTpx5sF9j7jKMBdb2fo_jROq2r-gPuQa3f6TLZlNCoK3lrscZ83-i1nP4TtVxq73XA May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 595a3d59c45f452d935dcec7a8938828 May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:08:59.575297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/595a3d59c45f452d935dcec7a8938828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/595a3d59c45f452d935dcec7a8938828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_595a3d59c45f452d935dcec7a8938828", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/595a3d59c45f452d935dcec7a8938828"}]}] May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 595a3d59c45f452d935dcec7a8938828 May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesSnapshotsTestJSON-321559047-project May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: eb0888d2b5024d558d15fe47e2d34ccb May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321559047-project May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '767c7173-a6f9-4776-9651-202629bb3722'} May 26 15:08:59.576613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. (HTTP 404) (Request-ID: req-e79e6bb7-9ac8-4cbc-a1d7-5b52119bbe00) May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.577383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:59.578446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 15:08:59.579472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.580612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:08:59.584791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-eac2b1ff-7ec0-4e69-823e-f23c24e1ad41 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Returning 404 to user: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:59.586064 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-eac2b1ff-7ec0-4e69-823e-f23c24e1ad41 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722" status: 404 len: 109 microversion: 2.1 time: 0.111818 May 26 15:08:59.587932 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 13/28] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:08:59 2022] GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:08:59.598885 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-02889e44-693f-4405-bba7-0d0169da5e96 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967e12b80>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:59.684681 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-02889e44-693f-4405-bba7-0d0169da5e96 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] HTTP exception thrown: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-02889e44-693f-4405-bba7-0d0169da5e96 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Request method failure captured: May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: DELETE /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 HTTP/1.1 May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5f-E76YkKoi3mMT-m9Xahh617Q1LHl2gEiATP4GntasttjW2qw7TWrZa5tVZXjxABmqtPEh4KSjldPl3DPabA-MyibdkbYBys3VqnBCKUrQZSTpx5sF9j7jKMBdb2fo_jROq2r-gPuQa3f6TLZlNCoK3lrscZ83-i1nP4TtVxq73XA May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 595a3d59c45f452d935dcec7a8938828 May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:08:59.694718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/595a3d59c45f452d935dcec7a8938828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/595a3d59c45f452d935dcec7a8938828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_595a3d59c45f452d935dcec7a8938828", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/595a3d59c45f452d935dcec7a8938828"}]}] May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 595a3d59c45f452d935dcec7a8938828 May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesSnapshotsTestJSON-321559047-project May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: eb0888d2b5024d558d15fe47e2d34ccb May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321559047-project May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '767c7173-a6f9-4776-9651-202629bb3722'} May 26 15:08:59.696043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. (HTTP 404) (Request-ID: req-3e242b36-0632-4db0-a4b7-c96e6e5bd9ab) May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.696742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 15:08:59.697827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 15:08:59.698806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.699849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.703540 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-02889e44-693f-4405-bba7-0d0169da5e96 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Returning 404 to user: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:59.704923 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-02889e44-693f-4405-bba7-0d0169da5e96 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722" status: 404 len: 109 microversion: 2.1 time: 0.111534 May 26 15:08:59.709785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2650debb-728c-4288-9cac-92d9044f2fc7 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:59.713077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 16/29] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:08:59 2022] DELETE /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:08:59.714374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2650debb-728c-4288-9cac-92d9044f2fc7 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:08:59.737839 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e68ff7b3-edf9-4fcf-b1cc-36763f83c6a1 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Calling method '.version_select at 0x7ff967dd3550>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:59.781950 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2650debb-728c-4288-9cac-92d9044f2fc7 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:59.782487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2650debb-728c-4288-9cac-92d9044f2fc7 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:59.786009 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2650debb-728c-4288-9cac-92d9044f2fc7 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:08:59.791257 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2650debb-728c-4288-9cac-92d9044f2fc7 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:08:59.812279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-e68ff7b3-edf9-4fcf-b1cc-36763f83c6a1 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] HTTP exception thrown: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e68ff7b3-edf9-4fcf-b1cc-36763f83c6a1 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Request method failure captured: May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 HTTP/1.1 May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5f-E76YkKoi3mMT-m9Xahh617Q1LHl2gEiATP4GntasttjW2qw7TWrZa5tVZXjxABmqtPEh4KSjldPl3DPabA-MyibdkbYBys3VqnBCKUrQZSTpx5sF9j7jKMBdb2fo_jROq2r-gPuQa3f6TLZlNCoK3lrscZ83-i1nP4TtVxq73XA May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 595a3d59c45f452d935dcec7a8938828 May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:08:59.814957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/595a3d59c45f452d935dcec7a8938828"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/595a3d59c45f452d935dcec7a8938828"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_595a3d59c45f452d935dcec7a8938828", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/595a3d59c45f452d935dcec7a8938828"}]}] May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 595a3d59c45f452d935dcec7a8938828 May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321559047 May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesSnapshotsTestJSON-321559047-project May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: eb0888d2b5024d558d15fe47e2d34ccb May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321559047-project May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '767c7173-a6f9-4776-9651-202629bb3722'} May 26 15:08:59.816017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. (HTTP 404) (Request-ID: req-00e65774-73e1-4050-80d1-fea51c5b086e) May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.816618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:08:59.820538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 15:08:59.821818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e68ff7b3-edf9-4fcf-b1cc-36763f83c6a1 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] Returning 404 to user: Volume 767c7173-a6f9-4776-9651-202629bb3722 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e68ff7b3-edf9-4fcf-b1cc-36763f83c6a1 tempest-VolumesSnapshotsTestJSON-321559047 tempest-VolumesSnapshotsTestJSON-321559047-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722" status: 404 len: 109 microversion: 2.1 time: 0.097983 May 26 15:08:59.823649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 17/30] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:08:59 2022] GET /compute/v2.1/os-volumes/767c7173-a6f9-4776-9651-202629bb3722 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:09:00.491595 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2650debb-728c-4288-9cac-92d9044f2fc7 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:00.534251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2650debb-728c-4288-9cac-92d9044f2fc7 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1275 microversion: 2.1 time: 0.840059 May 26 15:09:00.537910 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 14/31] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:08:59 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1275 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:01.554152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-20e9fb67-943b-4670-8508-06aa3cf95720 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:01.555535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-20e9fb67-943b-4670-8508-06aa3cf95720 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:01.599055 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-20e9fb67-943b-4670-8508-06aa3cf95720 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:01.612593 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-20e9fb67-943b-4670-8508-06aa3cf95720 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:01.614872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-20e9fb67-943b-4670-8508-06aa3cf95720 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:01.617770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-20e9fb67-943b-4670-8508-06aa3cf95720 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:02.431914 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-20e9fb67-943b-4670-8508-06aa3cf95720 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:02.507784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-20e9fb67-943b-4670-8508-06aa3cf95720 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1273 microversion: 2.1 time: 0.959944 May 26 15:09:02.508395 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 18/32] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:01 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1273 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:03.530912 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-44f3b2b9-dedf-426e-ad7b-9e78f67adf5f tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:03.532890 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-44f3b2b9-dedf-426e-ad7b-9e78f67adf5f tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:03.551128 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44f3b2b9-dedf-426e-ad7b-9e78f67adf5f tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:03.551739 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44f3b2b9-dedf-426e-ad7b-9e78f67adf5f tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:03.555704 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44f3b2b9-dedf-426e-ad7b-9e78f67adf5f tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:03.556867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44f3b2b9-dedf-426e-ad7b-9e78f67adf5f tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:04.108788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-44f3b2b9-dedf-426e-ad7b-9e78f67adf5f tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:04.121644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-44f3b2b9-dedf-426e-ad7b-9e78f67adf5f tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1273 microversion: 2.1 time: 0.598596 May 26 15:09:04.137524 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 15/33] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:03 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1273 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:05.144849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-973ac221-9950-4941-ac3e-21d1cebbc5a8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:05.145876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-973ac221-9950-4941-ac3e-21d1cebbc5a8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:05.165958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-973ac221-9950-4941-ac3e-21d1cebbc5a8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:05.166736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-973ac221-9950-4941-ac3e-21d1cebbc5a8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:05.170667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-973ac221-9950-4941-ac3e-21d1cebbc5a8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:05.171131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-973ac221-9950-4941-ac3e-21d1cebbc5a8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:06.634618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-973ac221-9950-4941-ac3e-21d1cebbc5a8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:06.667603 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-973ac221-9950-4941-ac3e-21d1cebbc5a8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 1.524807 May 26 15:09:06.668781 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 19/34] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:05 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:07.686214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-18e3bf83-d73d-45c8-8584-628ee401d6b8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:07.687216 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-18e3bf83-d73d-45c8-8584-628ee401d6b8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:07.714624 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:07.727257 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:07.741542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18e3bf83-d73d-45c8-8584-628ee401d6b8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:07.754686 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18e3bf83-d73d-45c8-8584-628ee401d6b8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:07.761501 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18e3bf83-d73d-45c8-8584-628ee401d6b8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:07.763003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18e3bf83-d73d-45c8-8584-628ee401d6b8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:08.560204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-18e3bf83-d73d-45c8-8584-628ee401d6b8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:08.573992 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-18e3bf83-d73d-45c8-8584-628ee401d6b8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 0.892751 May 26 15:09:08.574592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 16/35] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:07 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:09.042517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=6 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:09.594707 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5ad59ac0-5b12-4a4b-a80c-5c39d3538115 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:09.596140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5ad59ac0-5b12-4a4b-a80c-5c39d3538115 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:09.624449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5ad59ac0-5b12-4a4b-a80c-5c39d3538115 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:09.641867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5ad59ac0-5b12-4a4b-a80c-5c39d3538115 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:09.642922 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5ad59ac0-5b12-4a4b-a80c-5c39d3538115 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:09.651964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5ad59ac0-5b12-4a4b-a80c-5c39d3538115 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:10.557480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e98985cf-681b-4963-961c-00bb4ec6d5e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'create', calling method: .version_select at 0x7ff967d09670>, body: {"keypair": {"name": "tempest-keypair-1266453240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxH//kksO9pVnbS+Tv2ZoH+DJsI9ee7KLUlroMvw4XbHK8foHNdaftQ7VUg3erxhPF/t+PobsRWodiEof1ymf1oHMIajUIdJwFrmb2jRTRF+rOhKzMhf8ciEMVof/GA3Q=="}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:10.659101 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5ad59ac0-5b12-4a4b-a80c-5c39d3538115 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:10.673514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5ad59ac0-5b12-4a4b-a80c-5c39d3538115 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 1.082480 May 26 15:09:10.674545 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 17/36] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:09 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:10.688669 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8086a140-914c-412c-abdf-74e41ee412a6 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff966cc8310>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:10.808369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-e98985cf-681b-4963-961c-00bb4ec6d5e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Getting quotas for project d732418a4b2247e59ed96898b21cf6b1. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:10.839607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-e98985cf-681b-4963-961c-00bb4ec6d5e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Getting quotas for user 64aeada36ebe460e9969f1f048651e6d and project d732418a4b2247e59ed96898b21cf6b1. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:10.960744 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e98985cf-681b-4963-961c-00bb4ec6d5e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.934888 May 26 15:09:10.962167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 20/37] 10.222.0.46 () {62 vars in 1199 bytes} [Thu May 26 15:09:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1937 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 15:09:11.395763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8086a140-914c-412c-abdf-74e41ee412a6 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/a3f61b7c-c629-4a14-8fcc-cb3c5003ecc4" status: 200 len: 351 microversion: 2.1 time: 0.716227 May 26 15:09:11.396781 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 18/38] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:09:10 2022] GET /compute/v2.1/os-volumes/a3f61b7c-c629-4a14-8fcc-cb3c5003ecc4 => generated 351 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:11.692231 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-22f4a21d-8b41-4f1e-8939-e3947a832bfa tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:11.693101 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-22f4a21d-8b41-4f1e-8939-e3947a832bfa tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:11.721749 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4f4b3678-4b27-4aee-8bbf-390850b0aa22 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: .version_select at 0x7ff967d09e50>, body: {"keypair": {"name": "tempest-keypair-1061188028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfFl5YDHjs+B5X+L+gDkhct/HuH6i5wN24VvFG+XWO0gnfh+/H1YZCQeIyKlxWb46J/vAFfM2DQw3uy7ffXG/KixRnknMq6BRQP4grAU9R9TRZyMP5FlJEhbUrRlQKkZg=="}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:11.728801 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22f4a21d-8b41-4f1e-8939-e3947a832bfa tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:11.743069 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22f4a21d-8b41-4f1e-8939-e3947a832bfa tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:11.744479 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22f4a21d-8b41-4f1e-8939-e3947a832bfa tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:11.748225 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-22f4a21d-8b41-4f1e-8939-e3947a832bfa tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:11.864750 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-4f4b3678-4b27-4aee-8bbf-390850b0aa22 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for project 9780d0cae62c4f5088060b530571ebb3. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:11.893511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-4f4b3678-4b27-4aee-8bbf-390850b0aa22 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for user 2ce5b5d5a12743bc80a4b191c24ff52f and project 9780d0cae62c4f5088060b530571ebb3. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:11.983764 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4f4b3678-4b27-4aee-8bbf-390850b0aa22 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.019755 May 26 15:09:11.987753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 21/39] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:09:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:13.881044 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-395f6716-0641-475f-8849-a8fd42c1ce19 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'create', calling method: .version_select at 0x7ff96749b3a0>, body: {"keypair": {"name": "tempest-keypair-521377724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNX1WvcZ4N+fG6k/4ua9ItsbAxJ6mQWxus0PSWls21olBUIYQZfxx07BQSnmYs2ZF6rc9QSHk/KgpdC8q4mW7ikV4VibFRQXnlAaXu4fUQdZXn7RlQ8AIpEdq3Vw9uXT5g=="}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:13.962419 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-395f6716-0641-475f-8849-a8fd42c1ce19 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Getting quotas for project 0910873988084bc0becc79bb99febc96. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:13.972982 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-395f6716-0641-475f-8849-a8fd42c1ce19 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Getting quotas for user e95b6425286f4235b9d1802acddac4b8 and project 0910873988084bc0becc79bb99febc96. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:13.999517 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-22f4a21d-8b41-4f1e-8939-e3947a832bfa tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:14.007997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-22f4a21d-8b41-4f1e-8939-e3947a832bfa tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 2.320632 May 26 15:09:14.008639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 19/40] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:11 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:14.059040 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-395f6716-0641-475f-8849-a8fd42c1ce19 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.561305 May 26 15:09:14.071752 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 22/41] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:09:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:15.040366 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5642fc2d-1a2d-4115-aeda-e357bf48e59b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:15.041161 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5642fc2d-1a2d-4115-aeda-e357bf48e59b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:15.060675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5642fc2d-1a2d-4115-aeda-e357bf48e59b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:15.060675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5642fc2d-1a2d-4115-aeda-e357bf48e59b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:15.060675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5642fc2d-1a2d-4115-aeda-e357bf48e59b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:15.060675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5642fc2d-1a2d-4115-aeda-e357bf48e59b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:15.078535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1abe0d03-1da5-454e-80c7-88c6ee77a047 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff9674a09d0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:15.274818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1abe0d03-1da5-454e-80c7-88c6ee77a047 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/360e258d-511e-47ac-ac95-f60ce58715d4" status: 200 len: 351 microversion: 2.1 time: 0.203838 May 26 15:09:15.276761 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 23/42] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:09:15 2022] GET /compute/v2.1/os-volumes/360e258d-511e-47ac-ac95-f60ce58715d4 => generated 351 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:15.837252 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5642fc2d-1a2d-4115-aeda-e357bf48e59b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:15.856541 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5642fc2d-1a2d-4115-aeda-e357bf48e59b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 0.820372 May 26 15:09:15.861766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 20/43] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:15 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:16.877355 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=12 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:16.882584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-48bbf467-db80-45a4-b60a-fbde3a97026e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:16.883279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-48bbf467-db80-45a4-b60a-fbde3a97026e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:16.910168 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-48bbf467-db80-45a4-b60a-fbde3a97026e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.911022 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-48bbf467-db80-45a4-b60a-fbde3a97026e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:16.914244 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-48bbf467-db80-45a4-b60a-fbde3a97026e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:16.914946 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-48bbf467-db80-45a4-b60a-fbde3a97026e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:17.942244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-35c40736-0fbf-4970-8ca0-8aa79f10c50a req-562b2e43-c083-4c1a-9773-07d8f6a5cf5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36adfbf4-6054-422d-9c0a-f71051437895", "tag": "b9ffac19-267b-4766-ba46-ba00d2f456b7"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:18.030962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-35c40736-0fbf-4970-8ca0-8aa79f10c50a req-562b2e43-c083-4c1a-9773-07d8f6a5cf5d service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.041533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-35c40736-0fbf-4970-8ca0-8aa79f10c50a req-562b2e43-c083-4c1a-9773-07d8f6a5cf5d service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.117194 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-35c40736-0fbf-4970-8ca0-8aa79f10c50a req-562b2e43-c083-4c1a-9773-07d8f6a5cf5d service nova] Creating event network-changed:b9ffac19-267b-4766-ba46-ba00d2f456b7 for instance 36adfbf4-6054-422d-9c0a-f71051437895 on hv-cinder-78836 May 26 15:09:18.120498 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-35c40736-0fbf-4970-8ca0-8aa79f10c50a req-562b2e43-c083-4c1a-9773-07d8f6a5cf5d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 15:09:18.129544 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59e88693-f547-4f33-bd70-968bbfafa2c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.130397 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59e88693-f547-4f33-bd70-968bbfafa2c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.138061 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59e88693-f547-4f33-bd70-968bbfafa2c2 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:18.139400 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59e88693-f547-4f33-bd70-968bbfafa2c2 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:18.158514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.compute.rpcapi [None req-59e88693-f547-4f33-bd70-968bbfafa2c2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 15:09:18.159710 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59e88693-f547-4f33-bd70-968bbfafa2c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117723) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 15:09:18.209632 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-59e88693-f547-4f33-bd70-968bbfafa2c2 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.540550 May 26 15:09:18.211292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 21/44] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:18.225617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-78fcc00c-a57e-4a2d-9f50-ac3a0a83fe29 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff966c34790>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:18.369495 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-48bbf467-db80-45a4-b60a-fbde3a97026e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:18.384739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-48bbf467-db80-45a4-b60a-fbde3a97026e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 1.506368 May 26 15:09:18.409532 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 24/45] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:16 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:18.444575 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-78fcc00c-a57e-4a2d-9f50-ac3a0a83fe29 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/075267f9-4b02-4519-8ffb-479c63a86624" status: 200 len: 351 microversion: 2.1 time: 0.231462 May 26 15:09:18.446160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 22/46] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:09:18 2022] GET /compute/v2.1/os-volumes/075267f9-4b02-4519-8ffb-479c63a86624 => generated 351 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:18.462196 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4a83b8a2-fa03-46ae-afb7-cdd949767eb0 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff9674a0160>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:18.931236 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4a83b8a2-fa03-46ae-afb7-cdd949767eb0 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.476593 May 26 15:09:18.932430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 25/47] 10.222.0.46 () {58 vars in 1133 bytes} [Thu May 26 15:09:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:18.959569 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-43f2ba7b-f086-4750-8d7b-9c8a4c0754ed tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff966c231f0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:19.324120 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-43f2ba7b-f086-4750-8d7b-9c8a4c0754ed tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.369142 May 26 15:09:19.324709 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 23/48] 10.222.0.46 () {58 vars in 1148 bytes} [Thu May 26 15:09:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:19.342233 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-16639363-345e-4222-af19-67107a05488c tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff9674a0670>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:19.409965 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-dfba1520-ce27-4762-83b0-c2f38ead7b10 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:19.410908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-dfba1520-ce27-4762-83b0-c2f38ead7b10 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:19.424516 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:19.427069 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dfba1520-ce27-4762-83b0-c2f38ead7b10 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:19.428714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dfba1520-ce27-4762-83b0-c2f38ead7b10 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:19.430632 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dfba1520-ce27-4762-83b0-c2f38ead7b10 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:19.434336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dfba1520-ce27-4762-83b0-c2f38ead7b10 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:19.518647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=43 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:19.608959 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-16639363-345e-4222-af19-67107a05488c tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.274137 May 26 15:09:19.609714 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 26/49] 10.222.0.46 () {58 vars in 1133 bytes} [Thu May 26 15:09:19 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:19.623434 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-18a800e2-0ac2-43d5-8e50-cbf889cdc1b5 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff9674a2af0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:20.023548 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-18a800e2-0ac2-43d5-8e50-cbf889cdc1b5 tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.405674 May 26 15:09:20.024948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 27/50] 10.222.0.46 () {58 vars in 1166 bytes} [Thu May 26 15:09:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:20.040271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d262725b-1a90-4078-b195-ff27c6ddc26c tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff9674a2d30>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:20.118003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dfba1520-ce27-4762-83b0-c2f38ead7b10 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:20.146973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-dfba1520-ce27-4762-83b0-c2f38ead7b10 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 0.737966 May 26 15:09:20.148913 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 24/51] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:19 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:20.390563 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d262725b-1a90-4078-b195-ff27c6ddc26c tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.355956 May 26 15:09:20.393199 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 28/52] 10.222.0.46 () {58 vars in 1169 bytes} [Thu May 26 15:09:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:20.406212 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1baab4b8-ec71-4bb8-931d-daefd2d3650e tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff966c23af0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:20.682958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1baab4b8-ec71-4bb8-931d-daefd2d3650e tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.281029 May 26 15:09:20.683886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 25/53] 10.222.0.46 () {58 vars in 1154 bytes} [Thu May 26 15:09:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:20.695962 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c65a84f9-d75b-4137-9b3f-8b87aa6446bc tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff967cf1a60>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:20.782861 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1713294798", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cc6f64a-79d5-4535-9da7-4cf3dfad5e95"}], "security_groups": [{"name": "tempest-securitygroup--509131836"}], "key_name": "tempest-keypair-1266453240", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:20.917657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c65a84f9-d75b-4137-9b3f-8b87aa6446bc tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.222847 May 26 15:09:20.919973 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 29/54] 10.222.0.46 () {58 vars in 1187 bytes} [Thu May 26 15:09:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:09:20.947830 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-306a16ac-d486-4a48-b944-2acc43ab710b tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] Calling method '.version_select at 0x7ff9674a0280>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:21.108224 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-306a16ac-d486-4a48-b944-2acc43ab710b tempest-VolumesTestJSON-57478842 tempest-VolumesTestJSON-57478842-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.177331 May 26 15:09:21.109228 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 30/55] 10.222.0.46 () {58 vars in 1154 bytes} [Thu May 26 15:09:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:21.167417 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-72ac9917-725b-4858-b35d-3f8c71b39e78 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:21.168206 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-72ac9917-725b-4858-b35d-3f8c71b39e78 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:21.170344 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:21.194519 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-72ac9917-725b-4858-b35d-3f8c71b39e78 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.195422 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-72ac9917-725b-4858-b35d-3f8c71b39e78 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.196785 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-72ac9917-725b-4858-b35d-3f8c71b39e78 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:21.197522 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-72ac9917-725b-4858-b35d-3f8c71b39e78 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:21.714233 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] validate_networks() for [('4cc6f64a-79d5-4535-9da7-4cf3dfad5e95', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:22.326036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-72ac9917-725b-4858-b35d-3f8c71b39e78 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:22.335155 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-72ac9917-725b-4858-b35d-3f8c71b39e78 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 1.171907 May 26 15:09:22.343325 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 31/56] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:21 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:22.365485 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2040906093", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b416354-97a2-42f7-a460-05ec32c4591a"}], "security_groups": [{"name": "tempest-securitygroup--1746484121"}], "key_name": "tempest-keypair-521377724", "user_data": "}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:23.171702 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.network.neutron [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] validate_networks() for [('8b416354-97a2-42f7-a460-05ec32c4591a', None, None, None, None, None)] {{(pid=117724) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:24.008482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=12 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:24.791136 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:24.792279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:24.792957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:24.794641 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:24.795335 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:24.816027 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.816520 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.820725 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:24.823158 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:24.874282 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Getting quotas for project d732418a4b2247e59ed96898b21cf6b1. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:24.891380 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Getting quotas for user 64aeada36ebe460e9969f1f048651e6d and project d732418a4b2247e59ed96898b21cf6b1. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:24.916254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:09:24.920680 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:09:25.024046 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-097693f9-aa9b-42f2-912b-a62158a3ed29 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.248585 May 26 15:09:25.025201 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 26/57] 10.222.0.46 () {62 vars in 1187 bytes} [Thu May 26 15:09:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 4251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 15:09:25.030538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3a6b5cbb-369b-417b-bf49-1358eeeca7c5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:25.031167 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3a6b5cbb-369b-417b-bf49-1358eeeca7c5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:25.038183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a6b5cbb-369b-417b-bf49-1358eeeca7c5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.038846 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a6b5cbb-369b-417b-bf49-1358eeeca7c5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.039973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a6b5cbb-369b-417b-bf49-1358eeeca7c5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:25.040572 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a6b5cbb-369b-417b-bf49-1358eeeca7c5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:25.428427 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3a6b5cbb-369b-417b-bf49-1358eeeca7c5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:25.459696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3a6b5cbb-369b-417b-bf49-1358eeeca7c5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 0.433125 May 26 15:09:25.463393 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 27/58] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:25 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:25.482010 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6b136293-78a9-49f6-96a9-7ab998bc04a3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:25.485536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6b136293-78a9-49f6-96a9-7ab998bc04a3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:25.966957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6b136293-78a9-49f6-96a9-7ab998bc04a3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:25.986797 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Flavor limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:25.987252 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6b136293-78a9-49f6-96a9-7ab998bc04a3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:25.988166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Image limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:25.988595 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6b136293-78a9-49f6-96a9-7ab998bc04a3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:25.988994 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Flavor pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:25.989606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Image pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:25.990183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:25.990292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6b136293-78a9-49f6-96a9-7ab998bc04a3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1282 microversion: 2.20 time: 0.522134 May 26 15:09:25.991336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 28/59] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:25 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1282 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:26.008481 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-731869355", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf638e18-3aa1-4ba6-b2c0-e624f717acb0"}], "security_groups": [{"name": "tempest-securitygroup--1943555505"}], "key_name": "tempest-keypair-1061188028", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:26.013018 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.014383 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.015306 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.015767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.068976 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Getting quotas for project 0910873988084bc0becc79bb99febc96. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:26.074228 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Getting quotas for user e95b6425286f4235b9d1802acddac4b8 and project 0910873988084bc0becc79bb99febc96. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:26.086993 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Going to run 1 instances... {{(pid=117724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:09:26.090954 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:09:26.209400 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] validate_networks() for [('bf638e18-3aa1-4ba6-b2c0-e624f717acb0', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:26.228507 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b0905e97-cdb5-47b5-84e8-96beea162829 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.882767 May 26 15:09:26.235713 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 32/60] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:09:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 3891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:09:26.254177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0e36bc54-4248-4c8c-bcdd-7ecbee8ff546 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:26.254980 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0e36bc54-4248-4c8c-bcdd-7ecbee8ff546 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:26.699089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0e36bc54-4248-4c8c-bcdd-7ecbee8ff546 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:26.714167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0e36bc54-4248-4c8c-bcdd-7ecbee8ff546 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1237 microversion: 2.1 time: 0.473110 May 26 15:09:26.715095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 33/61] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:26 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1237 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:26.725221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8a3b0752-480d-4e8e-a377-e8d70b6e8df8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:26.728574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8a3b0752-480d-4e8e-a377-e8d70b6e8df8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:26.754187 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8a3b0752-480d-4e8e-a377-e8d70b6e8df8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.756082 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8a3b0752-480d-4e8e-a377-e8d70b6e8df8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:26.759840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8a3b0752-480d-4e8e-a377-e8d70b6e8df8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:26.761518 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8a3b0752-480d-4e8e-a377-e8d70b6e8df8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.278610 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8a3b0752-480d-4e8e-a377-e8d70b6e8df8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.291009 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8a3b0752-480d-4e8e-a377-e8d70b6e8df8 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 0.573889 May 26 15:09:27.292050 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 34/62] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:26 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:27.309077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:27.311454 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:27.332437 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:27.333208 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:27.333376 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:27.333822 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:27.334241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:27.344942 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.345988 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.346323 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.346523 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.347386 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.348332 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.349138 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.349509 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.374652 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for project 9780d0cae62c4f5088060b530571ebb3. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:09:27.382615 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for user 2ce5b5d5a12743bc80a4b191c24ff52f and project 9780d0cae62c4f5088060b530571ebb3. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:09:27.401547 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:09:27.406580 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:09:27.485333 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f8f2a2c9-96d3-4df0-9359-f48b22991a0b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.492213 May 26 15:09:27.490452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 29/63] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:09:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:09:27.633874 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.677481 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.690650 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.692304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8b7d363e-22a4-4594-8616-15f904ce12a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1334 microversion: 2.20 time: 0.393635 May 26 15:09:27.708351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 35/64] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:27 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1334 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:27.719438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-03a14e3e-12ad-4d1b-a958-cb18fc591d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:27.722336 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-03a14e3e-12ad-4d1b-a958-cb18fc591d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:27.799048 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-03a14e3e-12ad-4d1b-a958-cb18fc591d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.808910 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-03a14e3e-12ad-4d1b-a958-cb18fc591d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1241 microversion: 2.1 time: 0.098347 May 26 15:09:27.819704 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 36/65] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:27 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:27.819704 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0e5399e3-cf50-4449-bb85-5d04bd958e52 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:27.819704 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0e5399e3-cf50-4449-bb85-5d04bd958e52 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:27.836731 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0e5399e3-cf50-4449-bb85-5d04bd958e52 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.837202 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0e5399e3-cf50-4449-bb85-5d04bd958e52 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.838059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0e5399e3-cf50-4449-bb85-5d04bd958e52 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:27.838512 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0e5399e3-cf50-4449-bb85-5d04bd958e52 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:27.935509 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0e5399e3-cf50-4449-bb85-5d04bd958e52 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:27.944128 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0e5399e3-cf50-4449-bb85-5d04bd958e52 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1233 microversion: 2.1 time: 0.131946 May 26 15:09:27.949504 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 37/66] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:27 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1233 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:28.197027 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-1a21ee17-ba47-47d3-9a3f-5dfab87fcab8 req-90d456e1-387e-4b1c-9ca5-6ab3e3b15c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36adfbf4-6054-422d-9c0a-f71051437895", "name": "network-vif-plugged", "status": "completed", "tag": "b9ffac19-267b-4766-ba46-ba00d2f456b7"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:28.226349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-1a21ee17-ba47-47d3-9a3f-5dfab87fcab8 req-90d456e1-387e-4b1c-9ca5-6ab3e3b15c63 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.227298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-1a21ee17-ba47-47d3-9a3f-5dfab87fcab8 req-90d456e1-387e-4b1c-9ca5-6ab3e3b15c63 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.242336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-1a21ee17-ba47-47d3-9a3f-5dfab87fcab8 req-90d456e1-387e-4b1c-9ca5-6ab3e3b15c63 service nova] Creating event network-vif-plugged:b9ffac19-267b-4766-ba46-ba00d2f456b7 for instance 36adfbf4-6054-422d-9c0a-f71051437895 on hv-cinder-78836 May 26 15:09:28.249901 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-1a21ee17-ba47-47d3-9a3f-5dfab87fcab8 req-90d456e1-387e-4b1c-9ca5-6ab3e3b15c63 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.757137 May 26 15:09:28.256087 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 30/67] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:28.316338 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-09963586-0a4b-4cc6-8a84-5d0f67098980 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:28.317011 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-09963586-0a4b-4cc6-8a84-5d0f67098980 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:28.343901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-09963586-0a4b-4cc6-8a84-5d0f67098980 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.349412 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-09963586-0a4b-4cc6-8a84-5d0f67098980 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.351791 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-09963586-0a4b-4cc6-8a84-5d0f67098980 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.353608 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-09963586-0a4b-4cc6-8a84-5d0f67098980 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.730283 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:28.731577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:28.761336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.766802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:28.767938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:28.768467 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.152425 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.162168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.165882 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.167403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6b1b6696-4f7b-429f-91b4-15ab3c5bc671 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1340 microversion: 2.20 time: 0.451621 May 26 15:09:29.168165 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 31/68] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:28 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1340 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:29.188099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-443f07e2-f19a-4ac5-ac7b-5cec3254e3e9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:29.189115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-443f07e2-f19a-4ac5-ac7b-5cec3254e3e9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:29.201021 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-443f07e2-f19a-4ac5-ac7b-5cec3254e3e9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.202846 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-443f07e2-f19a-4ac5-ac7b-5cec3254e3e9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.203909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-443f07e2-f19a-4ac5-ac7b-5cec3254e3e9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.204514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-443f07e2-f19a-4ac5-ac7b-5cec3254e3e9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.292218 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-09963586-0a4b-4cc6-8a84-5d0f67098980 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.319186 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-09963586-0a4b-4cc6-8a84-5d0f67098980 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 1.013429 May 26 15:09:29.322300 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 38/69] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:28 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:29.333013 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-91479abc-5196-48d8-9bf6-3522ce24b774 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:29.334594 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-91479abc-5196-48d8-9bf6-3522ce24b774 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:29.359314 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-91479abc-5196-48d8-9bf6-3522ce24b774 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.360581 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-91479abc-5196-48d8-9bf6-3522ce24b774 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.366080 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-91479abc-5196-48d8-9bf6-3522ce24b774 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:29.368820 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-91479abc-5196-48d8-9bf6-3522ce24b774 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:29.387341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-443f07e2-f19a-4ac5-ac7b-5cec3254e3e9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.408480 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-443f07e2-f19a-4ac5-ac7b-5cec3254e3e9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1293 microversion: 2.1 time: 0.225504 May 26 15:09:29.411353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 32/70] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:29 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1293 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:29.539356 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-91479abc-5196-48d8-9bf6-3522ce24b774 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:29.564171 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-91479abc-5196-48d8-9bf6-3522ce24b774 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1295 microversion: 2.1 time: 0.239912 May 26 15:09:29.564779 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 39/71] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:29 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1295 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:30.190564 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:30.192676 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:30.204334 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.206559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.208843 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.209441 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.357172 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-cbf9d914-463e-4acc-b174-50aaafe7bb34 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:30.359249 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cbf9d914-463e-4acc-b174-50aaafe7bb34 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:30.383240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cbf9d914-463e-4acc-b174-50aaafe7bb34 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.385176 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cbf9d914-463e-4acc-b174-50aaafe7bb34 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.388445 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cbf9d914-463e-4acc-b174-50aaafe7bb34 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:30.389975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cbf9d914-463e-4acc-b174-50aaafe7bb34 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:30.954044 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-cbf9d914-463e-4acc-b174-50aaafe7bb34 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:30.955485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:30.965403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-cbf9d914-463e-4acc-b174-50aaafe7bb34 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1315 microversion: 2.1 time: 0.629632 May 26 15:09:30.970121 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 40/72] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:30 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:30.971520 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:30.973475 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:30.975054 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ea1151a9-e2fa-48fc-a534-3a4d7a3485fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1407 microversion: 2.20 time: 0.790905 May 26 15:09:30.975820 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 33/73] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:30 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1407 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:30.994482 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7afe60e0-d554-4840-89c4-95dc2d09f0e1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:30.999954 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7afe60e0-d554-4840-89c4-95dc2d09f0e1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:31.005879 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-57b04d5c-f1aa-4b0e-a219-a9c7658559d8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:31.007816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-57b04d5c-f1aa-4b0e-a219-a9c7658559d8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:31.013273 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7afe60e0-d554-4840-89c4-95dc2d09f0e1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.016835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7afe60e0-d554-4840-89c4-95dc2d09f0e1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.019790 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7afe60e0-d554-4840-89c4-95dc2d09f0e1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.020357 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7afe60e0-d554-4840-89c4-95dc2d09f0e1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.041283 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-57b04d5c-f1aa-4b0e-a219-a9c7658559d8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.044435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-57b04d5c-f1aa-4b0e-a219-a9c7658559d8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.048056 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-57b04d5c-f1aa-4b0e-a219-a9c7658559d8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:31.049751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-57b04d5c-f1aa-4b0e-a219-a9c7658559d8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:31.500710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-57b04d5c-f1aa-4b0e-a219-a9c7658559d8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:31.513129 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-57b04d5c-f1aa-4b0e-a219-a9c7658559d8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1299 microversion: 2.1 time: 0.541644 May 26 15:09:31.520917 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 41/74] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:30 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1299 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:31.525813 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7afe60e0-d554-4840-89c4-95dc2d09f0e1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:31.543616 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7afe60e0-d554-4840-89c4-95dc2d09f0e1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1295 microversion: 2.1 time: 0.565237 May 26 15:09:31.555814 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 34/75] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:30 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1295 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:31.997255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7495fb74-cc05-46e6-bf15-ebc04c036d4b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:31.997970 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7495fb74-cc05-46e6-bf15-ebc04c036d4b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:31.999904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:32.003147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:32.021844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7495fb74-cc05-46e6-bf15-ebc04c036d4b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.022065 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.023224 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7495fb74-cc05-46e6-bf15-ebc04c036d4b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.023570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.024639 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.024757 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7495fb74-cc05-46e6-bf15-ebc04c036d4b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.028044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7495fb74-cc05-46e6-bf15-ebc04c036d4b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.049645 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.641243 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7495fb74-cc05-46e6-bf15-ebc04c036d4b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.656972 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7495fb74-cc05-46e6-bf15-ebc04c036d4b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1502 microversion: 2.1 time: 0.664534 May 26 15:09:32.658609 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 35/76] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:31 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:32.666058 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-238c9cb4-4d88-481c-8292-b0aaec6aac64 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:32.668333 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-238c9cb4-4d88-481c-8292-b0aaec6aac64 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:32.686440 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.695886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-238c9cb4-4d88-481c-8292-b0aaec6aac64 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.700123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-238c9cb4-4d88-481c-8292-b0aaec6aac64 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.701403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.702641 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-238c9cb4-4d88-481c-8292-b0aaec6aac64 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.703265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-238c9cb4-4d88-481c-8292-b0aaec6aac64 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.704921 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:32.708121 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1a08183f-17d3-40ce-a645-02ff10338890 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1407 microversion: 2.20 time: 0.715873 May 26 15:09:32.709618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 42/77] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:31 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1407 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:32.724268 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1d075cb5-792b-4f79-82da-2c2a0dd463ba tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:32.725192 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1d075cb5-792b-4f79-82da-2c2a0dd463ba tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:32.740506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1d075cb5-792b-4f79-82da-2c2a0dd463ba tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.742456 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1d075cb5-792b-4f79-82da-2c2a0dd463ba tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:32.743984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1d075cb5-792b-4f79-82da-2c2a0dd463ba tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:32.746618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1d075cb5-792b-4f79-82da-2c2a0dd463ba tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.233337 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-238c9cb4-4d88-481c-8292-b0aaec6aac64 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:33.242572 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-238c9cb4-4d88-481c-8292-b0aaec6aac64 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.582495 May 26 15:09:33.243161 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 36/78] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:32 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:33.258739 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-7defa49f-e753-46ef-80d5-c025b3196ecc req-2ad405ce-8995-4205-b1b9-3938b85b1ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06cf01b4-e458-498b-990e-33b4171e1a14", "tag": "2e5306c2-86c5-4899-9abd-3ff6e390eb95"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:33.279608 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-7defa49f-e753-46ef-80d5-c025b3196ecc req-2ad405ce-8995-4205-b1b9-3938b85b1ce2 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.280458 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-7defa49f-e753-46ef-80d5-c025b3196ecc req-2ad405ce-8995-4205-b1b9-3938b85b1ce2 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.303311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-7defa49f-e753-46ef-80d5-c025b3196ecc req-2ad405ce-8995-4205-b1b9-3938b85b1ce2 service nova] Creating event network-changed:2e5306c2-86c5-4899-9abd-3ff6e390eb95 for instance 06cf01b4-e458-498b-990e-33b4171e1a14 on hv-cinder-78836 May 26 15:09:33.326592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-7defa49f-e753-46ef-80d5-c025b3196ecc req-2ad405ce-8995-4205-b1b9-3938b85b1ce2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073639 May 26 15:09:33.327214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 37/79] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:33.372995 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1d075cb5-792b-4f79-82da-2c2a0dd463ba tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:33.390161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1d075cb5-792b-4f79-82da-2c2a0dd463ba tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.676658 May 26 15:09:33.391432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 43/80] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:32 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:33.730302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:33.732024 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:33.746539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.752363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:33.754844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:33.756574 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.132697 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.145355 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.148109 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.149728 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e6370afd-281c-4dc4-9402-3488871a0e0b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1407 microversion: 2.20 time: 0.424769 May 26 15:09:34.151449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 38/81] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:33 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:34.259908 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ed146e53-400d-49c5-9f04-e98e23e7c7f7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:34.260524 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ed146e53-400d-49c5-9f04-e98e23e7c7f7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:34.289999 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ed146e53-400d-49c5-9f04-e98e23e7c7f7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.290583 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ed146e53-400d-49c5-9f04-e98e23e7c7f7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.291408 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ed146e53-400d-49c5-9f04-e98e23e7c7f7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.291842 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ed146e53-400d-49c5-9f04-e98e23e7c7f7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.408200 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-54bc8612-a424-484e-9e7e-ccba6b10bef0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:34.409052 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-54bc8612-a424-484e-9e7e-ccba6b10bef0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:34.421151 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54bc8612-a424-484e-9e7e-ccba6b10bef0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.422418 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54bc8612-a424-484e-9e7e-ccba6b10bef0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.426980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54bc8612-a424-484e-9e7e-ccba6b10bef0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.430748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54bc8612-a424-484e-9e7e-ccba6b10bef0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.586637 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ed146e53-400d-49c5-9f04-e98e23e7c7f7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.599940 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ed146e53-400d-49c5-9f04-e98e23e7c7f7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.343948 May 26 15:09:34.600521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 44/82] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:34 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:34.729176 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-54bc8612-a424-484e-9e7e-ccba6b10bef0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:34.733770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-10a52c33-a890-4705-82fc-cdee85dd0af9 req-9f78364a-72ba-45e0-836d-a2e45228e6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea4ff4a-0c29-465d-b388-d223fd508a69", "tag": "7c1e2fa5-dc43-40be-953e-bee74f2af6fd"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:34.750068 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-54bc8612-a424-484e-9e7e-ccba6b10bef0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.345611 May 26 15:09:34.750930 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 39/83] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:34 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:34.762495 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-583554f9-705c-4a12-90d8-d475f08329ff tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a78aee2-3b4d-42e4-8ecc-c80a0efc567a"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:34.763684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-583554f9-705c-4a12-90d8-d475f08329ff tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:34.768300 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-10a52c33-a890-4705-82fc-cdee85dd0af9 req-9f78364a-72ba-45e0-836d-a2e45228e6b0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.768970 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-10a52c33-a890-4705-82fc-cdee85dd0af9 req-9f78364a-72ba-45e0-836d-a2e45228e6b0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.772950 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-583554f9-705c-4a12-90d8-d475f08329ff tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.775587 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-583554f9-705c-4a12-90d8-d475f08329ff tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.776484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-583554f9-705c-4a12-90d8-d475f08329ff tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.776921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-583554f9-705c-4a12-90d8-d475f08329ff tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.798630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-10a52c33-a890-4705-82fc-cdee85dd0af9 req-9f78364a-72ba-45e0-836d-a2e45228e6b0 service nova] Creating event network-changed:7c1e2fa5-dc43-40be-953e-bee74f2af6fd for instance dea4ff4a-0c29-465d-b388-d223fd508a69 on hv-cinder-78836 May 26 15:09:34.799345 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-10a52c33-a890-4705-82fc-cdee85dd0af9 req-9f78364a-72ba-45e0-836d-a2e45228e6b0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 15:09:34.800570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9a799cba-b2c0-44d5-b2d2-925592b297e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.801543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9a799cba-b2c0-44d5-b2d2-925592b297e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.802514 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9a799cba-b2c0-44d5-b2d2-925592b297e5 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:34.803191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9a799cba-b2c0-44d5-b2d2-925592b297e5 None None] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:34.815903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.compute.rpcapi [None req-9a799cba-b2c0-44d5-b2d2-925592b297e5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 15:09:34.816893 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9a799cba-b2c0-44d5-b2d2-925592b297e5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 15:09:34.850321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9a799cba-b2c0-44d5-b2d2-925592b297e5 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244973 May 26 15:09:34.851078 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 45/84] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:35.172744 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:35.173489 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:35.184539 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.185005 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.185815 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.186269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.322393 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-583554f9-705c-4a12-90d8-d475f08329ff tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "POST /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569838 May 26 15:09:35.323960 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 40/85] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:09:34 2022] POST /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895/os-volume_attachments => generated 194 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:35.509746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.522455 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.525314 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.526767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9f565d34-706f-4f56-9193-ae18294d9fc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1407 microversion: 2.20 time: 0.358372 May 26 15:09:35.528875 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 46/86] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:35 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:35.617901 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-45b30e1f-1eb4-4301-9ba6-712765c360d0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:35.618722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-45b30e1f-1eb4-4301-9ba6-712765c360d0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:35.627997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45b30e1f-1eb4-4301-9ba6-712765c360d0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.634127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45b30e1f-1eb4-4301-9ba6-712765c360d0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.634968 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45b30e1f-1eb4-4301-9ba6-712765c360d0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.635419 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45b30e1f-1eb4-4301-9ba6-712765c360d0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.767877 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ac46146a-a5d6-4895-86c7-cd08e5647823 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:35.768499 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ac46146a-a5d6-4895-86c7-cd08e5647823 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:35.780603 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ac46146a-a5d6-4895-86c7-cd08e5647823 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.781179 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ac46146a-a5d6-4895-86c7-cd08e5647823 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.781866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ac46146a-a5d6-4895-86c7-cd08e5647823 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:35.782310 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ac46146a-a5d6-4895-86c7-cd08e5647823 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:35.851619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45b30e1f-1eb4-4301-9ba6-712765c360d0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:35.864665 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-45b30e1f-1eb4-4301-9ba6-712765c360d0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.250853 May 26 15:09:35.866979 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 41/87] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:35 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:36.045207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ac46146a-a5d6-4895-86c7-cd08e5647823 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:36.067430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ac46146a-a5d6-4895-86c7-cd08e5647823 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.301560 May 26 15:09:36.068058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 47/88] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:35 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:36.546062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:36.546704 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:36.572304 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:36.572754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:36.573593 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:36.574048 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:36.883879 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-70362f62-5545-4d18-9abd-82888afc0d4d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:36.884682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-70362f62-5545-4d18-9abd-82888afc0d4d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:36.902641 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-70362f62-5545-4d18-9abd-82888afc0d4d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:36.904174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-70362f62-5545-4d18-9abd-82888afc0d4d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:36.905671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-70362f62-5545-4d18-9abd-82888afc0d4d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:36.909112 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-70362f62-5545-4d18-9abd-82888afc0d4d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.037728 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.065847 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.070022 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.072415 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fc355b74-8bed-4add-9296-937041b3fd92 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1407 microversion: 2.20 time: 0.530611 May 26 15:09:37.072998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 42/89] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:36 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:09:37.081674 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-a551d02d-e359-4e11-8d6b-19d175bee427 req-c0797155-3cf6-404d-9b7a-8db3964be6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "957f4d2d-884d-44ff-9aee-1acf1b6c8959", "tag": "800ecb9f-4310-4563-b53c-ff8623e28b8e"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:37.096322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-a551d02d-e359-4e11-8d6b-19d175bee427 req-c0797155-3cf6-404d-9b7a-8db3964be6c5 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.096817 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-a551d02d-e359-4e11-8d6b-19d175bee427 req-c0797155-3cf6-404d-9b7a-8db3964be6c5 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.115342 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-a551d02d-e359-4e11-8d6b-19d175bee427 req-c0797155-3cf6-404d-9b7a-8db3964be6c5 service nova] Creating event network-changed:800ecb9f-4310-4563-b53c-ff8623e28b8e for instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 on hv-cinder-78836 May 26 15:09:37.123996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-a551d02d-e359-4e11-8d6b-19d175bee427 req-c0797155-3cf6-404d-9b7a-8db3964be6c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047379 May 26 15:09:37.125000 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 43/90] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:37.137060 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f140b8fa-adb7-44b7-9476-d72dcc588a02 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:37.141041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f140b8fa-adb7-44b7-9476-d72dcc588a02 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:37.154827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f140b8fa-adb7-44b7-9476-d72dcc588a02 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.155882 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f140b8fa-adb7-44b7-9476-d72dcc588a02 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.159259 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f140b8fa-adb7-44b7-9476-d72dcc588a02 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:37.161638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f140b8fa-adb7-44b7-9476-d72dcc588a02 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:37.334611 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-70362f62-5545-4d18-9abd-82888afc0d4d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.352641 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-70362f62-5545-4d18-9abd-82888afc0d4d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.473343 May 26 15:09:37.353749 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 48/91] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:36 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:37.363064 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:37.394195 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=14 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:37.631423 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f140b8fa-adb7-44b7-9476-d72dcc588a02 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:37.641586 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:37.648034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f140b8fa-adb7-44b7-9476-d72dcc588a02 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.520118 May 26 15:09:37.659788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 44/92] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:37 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:38.096798 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:38.097411 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:38.099415 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=10 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:38.113344 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.113840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.114624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.115067 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.157546 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:38.370871 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f4361788-2084-45e3-a23c-8ab7e0ab3258 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:38.370871 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f4361788-2084-45e3-a23c-8ab7e0ab3258 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:38.384123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4361788-2084-45e3-a23c-8ab7e0ab3258 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.388287 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4361788-2084-45e3-a23c-8ab7e0ab3258 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.389262 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4361788-2084-45e3-a23c-8ab7e0ab3258 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.402186 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f4361788-2084-45e3-a23c-8ab7e0ab3258 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.469259 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:38.484765 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:38.494844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:38.497757 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f017b2fc-f454-45b2-8692-e8aab3891eac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1407 microversion: 2.20 time: 0.404841 May 26 15:09:38.501488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 49/93] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:38 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:38.668181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-419e387f-0691-4e08-97cb-57ec6593b9d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:38.670170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-419e387f-0691-4e08-97cb-57ec6593b9d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:38.691376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-419e387f-0691-4e08-97cb-57ec6593b9d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.691847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-419e387f-0691-4e08-97cb-57ec6593b9d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.693372 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-419e387f-0691-4e08-97cb-57ec6593b9d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:38.693851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-419e387f-0691-4e08-97cb-57ec6593b9d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:38.904630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f4361788-2084-45e3-a23c-8ab7e0ab3258 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:38.930113 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f4361788-2084-45e3-a23c-8ab7e0ab3258 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.560927 May 26 15:09:38.934028 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 45/94] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:38 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:39.054916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-419e387f-0691-4e08-97cb-57ec6593b9d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.064919 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-419e387f-0691-4e08-97cb-57ec6593b9d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.402530 May 26 15:09:39.065555 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 50/95] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:38 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:39.224166 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-f5767894-c8bd-4008-8c59-92b3820a2107 req-d4749034-5d90-4067-a5f7-894a794a94a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06cf01b4-e458-498b-990e-33b4171e1a14", "name": "network-vif-plugged", "status": "completed", "tag": "2e5306c2-86c5-4899-9abd-3ff6e390eb95"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:39.247243 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f5767894-c8bd-4008-8c59-92b3820a2107 req-d4749034-5d90-4067-a5f7-894a794a94a3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.250026 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f5767894-c8bd-4008-8c59-92b3820a2107 req-d4749034-5d90-4067-a5f7-894a794a94a3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.494405 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-f5767894-c8bd-4008-8c59-92b3820a2107 req-d4749034-5d90-4067-a5f7-894a794a94a3 service nova] Creating event network-vif-plugged:2e5306c2-86c5-4899-9abd-3ff6e390eb95 for instance 06cf01b4-e458-498b-990e-33b4171e1a14 on hv-cinder-78836 May 26 15:09:39.503568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-f5767894-c8bd-4008-8c59-92b3820a2107 req-d4749034-5d90-4067-a5f7-894a794a94a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284943 May 26 15:09:39.505185 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 46/96] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:39.519168 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:39.520348 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:39.530229 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.539134 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.540325 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.540857 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.836248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.850278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.851956 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:39.853297 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ca4d7f9e-689e-40f6-b3f5-5606a152603a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1407 microversion: 2.20 time: 0.338619 May 26 15:09:39.868153 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 51/97] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:39 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:39.947350 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7428bbb5-3f71-4223-9745-174d3921c0ac tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:39.952745 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7428bbb5-3f71-4223-9745-174d3921c0ac tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:39.976517 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7428bbb5-3f71-4223-9745-174d3921c0ac tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.980612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7428bbb5-3f71-4223-9745-174d3921c0ac tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:39.982743 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7428bbb5-3f71-4223-9745-174d3921c0ac tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:39.985570 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7428bbb5-3f71-4223-9745-174d3921c0ac tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.084157 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f2e2ac68-dacf-4471-bfae-4492004184bf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:40.085096 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f2e2ac68-dacf-4471-bfae-4492004184bf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:40.093396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f2e2ac68-dacf-4471-bfae-4492004184bf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.098763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f2e2ac68-dacf-4471-bfae-4492004184bf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.099906 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f2e2ac68-dacf-4471-bfae-4492004184bf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.100770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f2e2ac68-dacf-4471-bfae-4492004184bf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.210510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7428bbb5-3f71-4223-9745-174d3921c0ac tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:40.222997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7428bbb5-3f71-4223-9745-174d3921c0ac tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.281362 May 26 15:09:40.223600 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 47/98] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:39 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:40.354278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f2e2ac68-dacf-4471-bfae-4492004184bf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:40.368191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f2e2ac68-dacf-4471-bfae-4492004184bf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.288892 May 26 15:09:40.368784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 52/99] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:40 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:40.879632 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:40.880861 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:40.893142 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.894631 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:40.899161 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:40.899928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.185275 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.197906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.200376 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.202555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bad87cec-5aad-4b24-b2af-85216e7c0057 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1407 microversion: 2.20 time: 0.326931 May 26 15:09:41.203968 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 48/100] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:40 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:41.245106 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e2822954-e618-420c-a5a6-7981b727d830 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:41.245764 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e2822954-e618-420c-a5a6-7981b727d830 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:41.259887 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2822954-e618-420c-a5a6-7981b727d830 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.260883 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2822954-e618-420c-a5a6-7981b727d830 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.262312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2822954-e618-420c-a5a6-7981b727d830 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.262983 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2822954-e618-420c-a5a6-7981b727d830 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.386813 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de5b94d0-3b87-417b-9de9-7e5f01f0d032 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:41.388024 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-de5b94d0-3b87-417b-9de9-7e5f01f0d032 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:41.400678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de5b94d0-3b87-417b-9de9-7e5f01f0d032 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.401661 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de5b94d0-3b87-417b-9de9-7e5f01f0d032 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.403434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de5b94d0-3b87-417b-9de9-7e5f01f0d032 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.403942 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de5b94d0-3b87-417b-9de9-7e5f01f0d032 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.448795 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e2822954-e618-420c-a5a6-7981b727d830 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.459098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e2822954-e618-420c-a5a6-7981b727d830 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.217967 May 26 15:09:41.459408 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 53/101] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:41 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:41.526111 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-5df54ebb-c6fe-46ab-bb7d-e2b413ac3d6c req-df4b8948-cbbb-49b4-b45d-eb0a07379a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea4ff4a-0c29-465d-b388-d223fd508a69", "name": "network-vif-plugged", "status": "completed", "tag": "7c1e2fa5-dc43-40be-953e-bee74f2af6fd"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:41.537096 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-5df54ebb-c6fe-46ab-bb7d-e2b413ac3d6c req-df4b8948-cbbb-49b4-b45d-eb0a07379a9c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:41.537998 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-5df54ebb-c6fe-46ab-bb7d-e2b413ac3d6c req-df4b8948-cbbb-49b4-b45d-eb0a07379a9c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:41.554444 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-5df54ebb-c6fe-46ab-bb7d-e2b413ac3d6c req-df4b8948-cbbb-49b4-b45d-eb0a07379a9c service nova] Creating event network-vif-plugged:7c1e2fa5-dc43-40be-953e-bee74f2af6fd for instance dea4ff4a-0c29-465d-b388-d223fd508a69 on hv-cinder-78836 May 26 15:09:41.560164 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-5df54ebb-c6fe-46ab-bb7d-e2b413ac3d6c req-df4b8948-cbbb-49b4-b45d-eb0a07379a9c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039936 May 26 15:09:41.560863 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 54/102] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:41.600408 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-de5b94d0-3b87-417b-9de9-7e5f01f0d032 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:41.613069 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-de5b94d0-3b87-417b-9de9-7e5f01f0d032 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.230666 May 26 15:09:41.613884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 49/103] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:41 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:42.226135 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:42.226990 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:42.236288 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.237896 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.245556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.247326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.427768 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:42.440347 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:42.443075 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:42.445006 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9b5e054a-5463-4c46-bf04-0176eb7e510e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1599 microversion: 2.20 time: 0.227058 May 26 15:09:42.446018 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 55/104] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:09:42 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:09:42.480124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-365d20e4-2359-4039-b534-30f5d99af610 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:42.480495 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-365d20e4-2359-4039-b534-30f5d99af610 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:42.485253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c3ff2faa-f182-4bb5-8bc8-b3b3321fa0b1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:42.486054 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c3ff2faa-f182-4bb5-8bc8-b3b3321fa0b1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:42.499182 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-365d20e4-2359-4039-b534-30f5d99af610 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.499452 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-365d20e4-2359-4039-b534-30f5d99af610 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.500283 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-365d20e4-2359-4039-b534-30f5d99af610 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.500716 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-365d20e4-2359-4039-b534-30f5d99af610 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.504639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3ff2faa-f182-4bb5-8bc8-b3b3321fa0b1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.505204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3ff2faa-f182-4bb5-8bc8-b3b3321fa0b1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.509194 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3ff2faa-f182-4bb5-8bc8-b3b3321fa0b1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.510091 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3ff2faa-f182-4bb5-8bc8-b3b3321fa0b1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.680955 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c3ff2faa-f182-4bb5-8bc8-b3b3321fa0b1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.210577 May 26 15:09:42.681665 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 50/105] 10.222.0.46 () {60 vars in 1315 bytes} [Thu May 26 15:09:42 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:09:42.688625 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0aef7425-60b5-44c8-a870-3f13d3d30563 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:42.689753 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0aef7425-60b5-44c8-a870-3f13d3d30563 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:42.707410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0aef7425-60b5-44c8-a870-3f13d3d30563 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.708216 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0aef7425-60b5-44c8-a870-3f13d3d30563 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.709563 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0aef7425-60b5-44c8-a870-3f13d3d30563 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:42.710774 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0aef7425-60b5-44c8-a870-3f13d3d30563 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:42.848976 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-365d20e4-2359-4039-b534-30f5d99af610 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:42.860430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-365d20e4-2359-4039-b534-30f5d99af610 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.384224 May 26 15:09:42.862419 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 56/106] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:42 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:42.990175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0aef7425-60b5-44c8-a870-3f13d3d30563 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:42.994601 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0aef7425-60b5-44c8-a870-3f13d3d30563 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.311521 May 26 15:09:42.995169 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 51/107] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:42 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:43.587057 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-34fbf340-7d94-4ea6-ab18-0e3f23dcc84b req-bb46e935-0772-4dca-b3d2-d539c4c34bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "957f4d2d-884d-44ff-9aee-1acf1b6c8959", "name": "network-vif-plugged", "status": "completed", "tag": "800ecb9f-4310-4563-b53c-ff8623e28b8e"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:43.599407 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-34fbf340-7d94-4ea6-ab18-0e3f23dcc84b req-bb46e935-0772-4dca-b3d2-d539c4c34bd5 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.599864 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-34fbf340-7d94-4ea6-ab18-0e3f23dcc84b req-bb46e935-0772-4dca-b3d2-d539c4c34bd5 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.615381 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-34fbf340-7d94-4ea6-ab18-0e3f23dcc84b req-bb46e935-0772-4dca-b3d2-d539c4c34bd5 service nova] Creating event network-vif-plugged:800ecb9f-4310-4563-b53c-ff8623e28b8e for instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 on hv-cinder-78836 May 26 15:09:43.623768 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-34fbf340-7d94-4ea6-ab18-0e3f23dcc84b req-bb46e935-0772-4dca-b3d2-d539c4c34bd5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042199 May 26 15:09:43.625273 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 57/108] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:43.883029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f8e3ec32-1aa5-4c87-9fba-0170495fa7cf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:43.884567 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f8e3ec32-1aa5-4c87-9fba-0170495fa7cf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:43.899730 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8e3ec32-1aa5-4c87-9fba-0170495fa7cf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.904062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8e3ec32-1aa5-4c87-9fba-0170495fa7cf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:43.905926 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8e3ec32-1aa5-4c87-9fba-0170495fa7cf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:43.908109 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8e3ec32-1aa5-4c87-9fba-0170495fa7cf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.015870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e3e2a646-44af-4e67-a1e4-48c912bf4c2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:44.017794 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e3e2a646-44af-4e67-a1e4-48c912bf4c2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:44.046367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3e2a646-44af-4e67-a1e4-48c912bf4c2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.046807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3e2a646-44af-4e67-a1e4-48c912bf4c2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.051073 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3e2a646-44af-4e67-a1e4-48c912bf4c2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.051837 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3e2a646-44af-4e67-a1e4-48c912bf4c2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.292123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f8e3ec32-1aa5-4c87-9fba-0170495fa7cf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:44.300867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f8e3ec32-1aa5-4c87-9fba-0170495fa7cf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.422116 May 26 15:09:44.317957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 52/109] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:43 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:44.368271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e3e2a646-44af-4e67-a1e4-48c912bf4c2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:44.385132 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e3e2a646-44af-4e67-a1e4-48c912bf4c2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1363 microversion: 2.1 time: 0.373967 May 26 15:09:44.386522 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 58/110] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:44 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:44.914127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-fe64435e-61d8-4052-b87d-bf6198ce2b2a req-bcc21573-56d8-472d-8149-b0efe6c5dcf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06cf01b4-e458-498b-990e-33b4171e1a14", "tag": "2e5306c2-86c5-4899-9abd-3ff6e390eb95"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:44.931231 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-fe64435e-61d8-4052-b87d-bf6198ce2b2a req-bcc21573-56d8-472d-8149-b0efe6c5dcf3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:44.932231 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-fe64435e-61d8-4052-b87d-bf6198ce2b2a req-bcc21573-56d8-472d-8149-b0efe6c5dcf3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:44.947737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-fe64435e-61d8-4052-b87d-bf6198ce2b2a req-bcc21573-56d8-472d-8149-b0efe6c5dcf3 service nova] Creating event network-changed:2e5306c2-86c5-4899-9abd-3ff6e390eb95 for instance 06cf01b4-e458-498b-990e-33b4171e1a14 on hv-cinder-78836 May 26 15:09:44.955821 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-fe64435e-61d8-4052-b87d-bf6198ce2b2a req-bcc21573-56d8-472d-8149-b0efe6c5dcf3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048723 May 26 15:09:44.957292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 53/111] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:45.332501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-19a055f6-d5c9-4419-a9d8-7f204676b52a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:45.333548 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-19a055f6-d5c9-4419-a9d8-7f204676b52a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:45.338934 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=4 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:45.352235 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-19a055f6-d5c9-4419-a9d8-7f204676b52a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.352854 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-19a055f6-d5c9-4419-a9d8-7f204676b52a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.354290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-19a055f6-d5c9-4419-a9d8-7f204676b52a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.356592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-19a055f6-d5c9-4419-a9d8-7f204676b52a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.407343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9eeac878-c832-4f6f-9fee-fced1ec88bbe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:45.408673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9eeac878-c832-4f6f-9fee-fced1ec88bbe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:45.428555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9eeac878-c832-4f6f-9fee-fced1ec88bbe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.429444 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9eeac878-c832-4f6f-9fee-fced1ec88bbe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.432351 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9eeac878-c832-4f6f-9fee-fced1ec88bbe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:45.433265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9eeac878-c832-4f6f-9fee-fced1ec88bbe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:45.725560 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-19a055f6-d5c9-4419-a9d8-7f204676b52a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:45.743186 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-19a055f6-d5c9-4419-a9d8-7f204676b52a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.414839 May 26 15:09:45.744123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 59/112] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:45 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:45.982552 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9eeac878-c832-4f6f-9fee-fced1ec88bbe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:45.998084 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9eeac878-c832-4f6f-9fee-fced1ec88bbe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1549 microversion: 2.1 time: 0.597679 May 26 15:09:46.026503 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6cc98e0e-6703-4fb7-86d0-59509e62d7ec tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:46.027313 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6cc98e0e-6703-4fb7-86d0-59509e62d7ec tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:46.031896 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 54/113] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:45 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1549 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:09:46.039884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6cc98e0e-6703-4fb7-86d0-59509e62d7ec tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.042053 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6cc98e0e-6703-4fb7-86d0-59509e62d7ec tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.043153 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6cc98e0e-6703-4fb7-86d0-59509e62d7ec tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.044903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6cc98e0e-6703-4fb7-86d0-59509e62d7ec tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.272830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4bdad798-c07d-41df-919c-45a83a15282a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:46.273335 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4bdad798-c07d-41df-919c-45a83a15282a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:46.283322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4bdad798-c07d-41df-919c-45a83a15282a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.284105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4bdad798-c07d-41df-919c-45a83a15282a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.284935 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4bdad798-c07d-41df-919c-45a83a15282a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.293563 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4bdad798-c07d-41df-919c-45a83a15282a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.356965 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4bdad798-c07d-41df-919c-45a83a15282a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:09:46.411726 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6cc98e0e-6703-4fb7-86d0-59509e62d7ec tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.390377 May 26 15:09:46.412403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 60/114] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 15:09:46 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/os-interface => generated 285 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:46.562213 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:46.592846 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4bdad798-c07d-41df-919c-45a83a15282a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "DELETE /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 204 len: 0 microversion: 2.1 time: 0.323783 May 26 15:09:46.601257 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 55/115] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:09:46 2022] DELETE /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:09:46.612125 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0b3ebbde-e3c0-4000-86d3-6db57eaef824 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:46.612748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0b3ebbde-e3c0-4000-86d3-6db57eaef824 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:46.619361 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0b3ebbde-e3c0-4000-86d3-6db57eaef824 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.619819 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0b3ebbde-e3c0-4000-86d3-6db57eaef824 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.620591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0b3ebbde-e3c0-4000-86d3-6db57eaef824 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.621021 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0b3ebbde-e3c0-4000-86d3-6db57eaef824 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.767253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bb188698-30c3-4f65-98c8-6c147587f291 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:46.768392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bb188698-30c3-4f65-98c8-6c147587f291 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:46.789778 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb188698-30c3-4f65-98c8-6c147587f291 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.790767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb188698-30c3-4f65-98c8-6c147587f291 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.793415 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb188698-30c3-4f65-98c8-6c147587f291 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:46.795233 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb188698-30c3-4f65-98c8-6c147587f291 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:46.962782 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0b3ebbde-e3c0-4000-86d3-6db57eaef824 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:46.981731 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0b3ebbde-e3c0-4000-86d3-6db57eaef824 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1554 microversion: 2.1 time: 0.374555 May 26 15:09:46.983029 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 61/116] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:46 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:47.102998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bb188698-30c3-4f65-98c8-6c147587f291 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:47.114550 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bb188698-30c3-4f65-98c8-6c147587f291 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.353901 May 26 15:09:47.116263 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 56/117] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:46 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:48.002376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-10a91085-2756-483e-a472-8a4edb6dbc9d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:48.003679 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-10a91085-2756-483e-a472-8a4edb6dbc9d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:48.010727 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-10a91085-2756-483e-a472-8a4edb6dbc9d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.011377 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-10a91085-2756-483e-a472-8a4edb6dbc9d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.012871 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-10a91085-2756-483e-a472-8a4edb6dbc9d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.013469 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-10a91085-2756-483e-a472-8a4edb6dbc9d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.138619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6d9073a6-7312-462f-8252-f656b511c0af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:48.141946 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6d9073a6-7312-462f-8252-f656b511c0af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:48.155845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d9073a6-7312-462f-8252-f656b511c0af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.157419 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d9073a6-7312-462f-8252-f656b511c0af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.159041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d9073a6-7312-462f-8252-f656b511c0af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.160179 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d9073a6-7312-462f-8252-f656b511c0af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.339805 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-10a91085-2756-483e-a472-8a4edb6dbc9d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:48.349063 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-10a91085-2756-483e-a472-8a4edb6dbc9d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1554 microversion: 2.1 time: 0.351805 May 26 15:09:48.349951 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 62/118] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:47 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1554 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:48.548699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6d9073a6-7312-462f-8252-f656b511c0af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:48.570122 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6d9073a6-7312-462f-8252-f656b511c0af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1367 microversion: 2.1 time: 0.436005 May 26 15:09:48.573522 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 57/119] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:48 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1367 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:48.597966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-65633108-088f-4d12-8d11-bedbdee8b803 req-9af4737f-838c-44f7-b07f-03ab4ad5299c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea4ff4a-0c29-465d-b388-d223fd508a69", "tag": "7c1e2fa5-dc43-40be-953e-bee74f2af6fd"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:48.625328 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-65633108-088f-4d12-8d11-bedbdee8b803 req-9af4737f-838c-44f7-b07f-03ab4ad5299c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:48.625808 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-65633108-088f-4d12-8d11-bedbdee8b803 req-9af4737f-838c-44f7-b07f-03ab4ad5299c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:48.656798 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-65633108-088f-4d12-8d11-bedbdee8b803 req-9af4737f-838c-44f7-b07f-03ab4ad5299c service nova] Creating event network-changed:7c1e2fa5-dc43-40be-953e-bee74f2af6fd for instance dea4ff4a-0c29-465d-b388-d223fd508a69 on hv-cinder-78836 May 26 15:09:48.667799 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-65633108-088f-4d12-8d11-bedbdee8b803 req-9af4737f-838c-44f7-b07f-03ab4ad5299c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075716 May 26 15:09:48.670270 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 63/120] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:49.368609 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1465db2f-7d11-4ffe-8da6-068dd4a74211 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:49.370472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1465db2f-7d11-4ffe-8da6-068dd4a74211 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:49.397695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1465db2f-7d11-4ffe-8da6-068dd4a74211 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.399390 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1465db2f-7d11-4ffe-8da6-068dd4a74211 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.403259 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1465db2f-7d11-4ffe-8da6-068dd4a74211 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.405874 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1465db2f-7d11-4ffe-8da6-068dd4a74211 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.594117 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-77cfa339-9ef9-4a55-baac-de95f173e0ee tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:49.596289 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-77cfa339-9ef9-4a55-baac-de95f173e0ee tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:49.616275 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-77cfa339-9ef9-4a55-baac-de95f173e0ee tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.620098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-77cfa339-9ef9-4a55-baac-de95f173e0ee tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:49.622111 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-77cfa339-9ef9-4a55-baac-de95f173e0ee tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:49.629200 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-77cfa339-9ef9-4a55-baac-de95f173e0ee tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:50.057518 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-77cfa339-9ef9-4a55-baac-de95f173e0ee tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:50.067730 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-77cfa339-9ef9-4a55-baac-de95f173e0ee tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1557 microversion: 2.1 time: 0.480157 May 26 15:09:50.082257 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 64/121] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:49 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1557 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:50.110568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1465db2f-7d11-4ffe-8da6-068dd4a74211 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:50.114754 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bab571b4-22a3-482f-af9c-09996ff36569 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:50.119521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bab571b4-22a3-482f-af9c-09996ff36569 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:50.123918 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1465db2f-7d11-4ffe-8da6-068dd4a74211 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1554 microversion: 2.1 time: 0.760203 May 26 15:09:50.133137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bab571b4-22a3-482f-af9c-09996ff36569 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:50.134778 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bab571b4-22a3-482f-af9c-09996ff36569 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:50.135866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bab571b4-22a3-482f-af9c-09996ff36569 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:50.137736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bab571b4-22a3-482f-af9c-09996ff36569 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:50.140763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 58/122] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:49 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1554 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:50.310769 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bab571b4-22a3-482f-af9c-09996ff36569 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210553 May 26 15:09:50.311753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 65/123] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 15:09:50 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-interface => generated 284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:51.148173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a95eff1a-8a8f-4fd5-8f04-b4ff497d9bb5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:51.149356 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a95eff1a-8a8f-4fd5-8f04-b4ff497d9bb5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:51.156648 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a95eff1a-8a8f-4fd5-8f04-b4ff497d9bb5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:51.158703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a95eff1a-8a8f-4fd5-8f04-b4ff497d9bb5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.158703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a95eff1a-8a8f-4fd5-8f04-b4ff497d9bb5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:51.158703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a95eff1a-8a8f-4fd5-8f04-b4ff497d9bb5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.360819 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a95eff1a-8a8f-4fd5-8f04-b4ff497d9bb5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:51.373808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a95eff1a-8a8f-4fd5-8f04-b4ff497d9bb5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1554 microversion: 2.1 time: 0.229968 May 26 15:09:51.384883 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 59/124] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:51 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:51.718238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-18f0bbaa-48b7-45db-990a-84c7fba87b33 req-4546b1d3-fa50-4f19-86e1-73caee9f24c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "957f4d2d-884d-44ff-9aee-1acf1b6c8959", "tag": "800ecb9f-4310-4563-b53c-ff8623e28b8e"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:51.726712 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:51.729912 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-18f0bbaa-48b7-45db-990a-84c7fba87b33 req-4546b1d3-fa50-4f19-86e1-73caee9f24c0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:51.731315 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-18f0bbaa-48b7-45db-990a-84c7fba87b33 req-4546b1d3-fa50-4f19-86e1-73caee9f24c0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:51.748755 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-18f0bbaa-48b7-45db-990a-84c7fba87b33 req-4546b1d3-fa50-4f19-86e1-73caee9f24c0 service nova] Creating event network-changed:800ecb9f-4310-4563-b53c-ff8623e28b8e for instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 on hv-cinder-78836 May 26 15:09:51.754317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-18f0bbaa-48b7-45db-990a-84c7fba87b33 req-4546b1d3-fa50-4f19-86e1-73caee9f24c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040054 May 26 15:09:51.755298 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 66/125] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:52.394270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-54ac3d52-8df1-41fb-99a1-0ced2c58b9d5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:52.396092 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-54ac3d52-8df1-41fb-99a1-0ced2c58b9d5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:52.408940 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54ac3d52-8df1-41fb-99a1-0ced2c58b9d5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.409908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54ac3d52-8df1-41fb-99a1-0ced2c58b9d5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.411052 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54ac3d52-8df1-41fb-99a1-0ced2c58b9d5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.411701 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-54ac3d52-8df1-41fb-99a1-0ced2c58b9d5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.750748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-54ac3d52-8df1-41fb-99a1-0ced2c58b9d5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:52.800296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-54ac3d52-8df1-41fb-99a1-0ced2c58b9d5 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1554 microversion: 2.1 time: 0.412220 May 26 15:09:52.805679 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 60/126] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:52 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1554 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:52.900217 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-77ab3a16-7c0a-4baf-a2f9-28e0910c8c92 req-3fff3bfb-a2d5-4a33-a917-5235601e3857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36adfbf4-6054-422d-9c0a-f71051437895", "name": "network-vif-unplugged", "status": "completed", "tag": "b9ffac19-267b-4766-ba46-ba00d2f456b7"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:52.925945 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-77ab3a16-7c0a-4baf-a2f9-28e0910c8c92 req-3fff3bfb-a2d5-4a33-a917-5235601e3857 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:52.926397 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-77ab3a16-7c0a-4baf-a2f9-28e0910c8c92 req-3fff3bfb-a2d5-4a33-a917-5235601e3857 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:52.971614 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-77ab3a16-7c0a-4baf-a2f9-28e0910c8c92 req-3fff3bfb-a2d5-4a33-a917-5235601e3857 service nova] Creating event network-vif-unplugged:b9ffac19-267b-4766-ba46-ba00d2f456b7 for instance 36adfbf4-6054-422d-9c0a-f71051437895 on hv-cinder-78836 May 26 15:09:52.988198 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-77ab3a16-7c0a-4baf-a2f9-28e0910c8c92 req-3fff3bfb-a2d5-4a33-a917-5235601e3857 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092216 May 26 15:09:52.989997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 67/127] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:53.831597 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8aa4917b-0b75-49a8-919f-226488dd2e99 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:53.832622 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8aa4917b-0b75-49a8-919f-226488dd2e99 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:53.844680 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8aa4917b-0b75-49a8-919f-226488dd2e99 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.847881 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8aa4917b-0b75-49a8-919f-226488dd2e99 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.849515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8aa4917b-0b75-49a8-919f-226488dd2e99 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:53.851349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8aa4917b-0b75-49a8-919f-226488dd2e99 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:53.873907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:54.069497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8aa4917b-0b75-49a8-919f-226488dd2e99 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:54.091221 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8aa4917b-0b75-49a8-919f-226488dd2e99 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1554 microversion: 2.1 time: 0.265986 May 26 15:09:54.092974 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 61/128] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:53 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1554 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:54.255740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-52492952-90c1-48e3-85c1-bbec8ca81e84 req-7d6575e1-b40d-443f-9c1a-2815d976dc5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36adfbf4-6054-422d-9c0a-f71051437895", "name": "network-vif-deleted", "tag": "b9ffac19-267b-4766-ba46-ba00d2f456b7"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:54.270581 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-52492952-90c1-48e3-85c1-bbec8ca81e84 req-7d6575e1-b40d-443f-9c1a-2815d976dc5c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:54.272959 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-52492952-90c1-48e3-85c1-bbec8ca81e84 req-7d6575e1-b40d-443f-9c1a-2815d976dc5c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:54.290126 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-52492952-90c1-48e3-85c1-bbec8ca81e84 req-7d6575e1-b40d-443f-9c1a-2815d976dc5c service nova] Creating event network-vif-deleted:b9ffac19-267b-4766-ba46-ba00d2f456b7 for instance 36adfbf4-6054-422d-9c0a-f71051437895 on hv-cinder-78836 May 26 15:09:54.298114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-52492952-90c1-48e3-85c1-bbec8ca81e84 req-7d6575e1-b40d-443f-9c1a-2815d976dc5c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049558 May 26 15:09:54.303740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 68/129] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:55.117755 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1c9f449d-facd-4196-b545-dccbef0c95a3 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:55.119246 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1c9f449d-facd-4196-b545-dccbef0c95a3 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:55.128129 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c9f449d-facd-4196-b545-dccbef0c95a3 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:55.128772 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c9f449d-facd-4196-b545-dccbef0c95a3 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:55.129577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c9f449d-facd-4196-b545-dccbef0c95a3 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:55.130010 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c9f449d-facd-4196-b545-dccbef0c95a3 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:55.224198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c9f449d-facd-4196-b545-dccbef0c95a3 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:55.233790 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1c9f449d-facd-4196-b545-dccbef0c95a3 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1346 microversion: 2.1 time: 0.120912 May 26 15:09:55.234603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 62/130] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:55 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:56.251549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6acb1194-27e5-4474-95c7-75b61f57046d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:56.252877 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6acb1194-27e5-4474-95c7-75b61f57046d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:56.263480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6acb1194-27e5-4474-95c7-75b61f57046d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:56.268509 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6acb1194-27e5-4474-95c7-75b61f57046d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:56.269514 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6acb1194-27e5-4474-95c7-75b61f57046d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:56.270078 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6acb1194-27e5-4474-95c7-75b61f57046d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:56.358870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6acb1194-27e5-4474-95c7-75b61f57046d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:56.367371 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6acb1194-27e5-4474-95c7-75b61f57046d tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1346 microversion: 2.1 time: 0.120361 May 26 15:09:56.368394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 69/131] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:56 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:57.386483 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5cc09086-2dd4-48b5-83c3-c907c3ae0bc0 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:57.387119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5cc09086-2dd4-48b5-83c3-c907c3ae0bc0 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:57.393558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5cc09086-2dd4-48b5-83c3-c907c3ae0bc0 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.394006 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5cc09086-2dd4-48b5-83c3-c907c3ae0bc0 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.394759 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5cc09086-2dd4-48b5-83c3-c907c3ae0bc0 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:57.395192 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5cc09086-2dd4-48b5-83c3-c907c3ae0bc0 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:57.470112 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5cc09086-2dd4-48b5-83c3-c907c3ae0bc0 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:57.478096 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5cc09086-2dd4-48b5-83c3-c907c3ae0bc0 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1346 microversion: 2.1 time: 0.095552 May 26 15:09:57.478673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 63/132] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:57 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:58.495234 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:58.495849 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:58.503069 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.503556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.504386 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.543840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:58.544296 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:58.544760 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lazy-loading 'fault' on Instance uuid 36adfbf4-6054-422d-9c0a-f71051437895 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:09:58.553041 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:09:58.602044 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '166bfe89e44847d7b380f33e2e28401d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac537167367948ef88587242df4e921d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:09:58.618451 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-627adcf0-a8d5-4398-b78b-84baeca85f2b tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 200 len: 1351 microversion: 2.1 time: 0.126944 May 26 15:09:58.619643 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 70/133] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:58 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 1351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:09:59.277791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-240338614", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "networks": [{"uuid": "20da5449-4dfc-42c3-9de2-12d598d13a52"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:09:59.353870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] validate_networks() for [('20da5449-4dfc-42c3-9de2-12d598d13a52', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:09:59.637737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:59.638486 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:59.645316 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.645803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.646585 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.647039 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.672170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] HTTP exception thrown: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Request method failure captured: May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 HTTP/1.1 May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gCRukCFG22AouWB0Iyojq2zina17EMXdJeSTvStR41ZhVUVbsmnBsc8E3WSqjOIE6X3_yof2jKrE0_alpOmBDqFScqezh7uIqcRBWzHnUNBU7a23Jh-SnanTe8EaZiygbqjBsHlmMHgfBlFuHvK34F5RGdZBsuoEzGeXFLt8-EZAo May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: ac537167367948ef88587242df4e921d May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-DeleteServersTestJSON-1253958708 May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:09:59.677195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ac537167367948ef88587242df4e921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ac537167367948ef88587242df4e921d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ac537167367948ef88587242df4e921d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ac537167367948ef88587242df4e921d"}]}] May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-DeleteServersTestJSON-1253958708 May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: ac537167367948ef88587242df4e921d May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1253958708 May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-DeleteServersTestJSON-1253958708-project May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 166bfe89e44847d7b380f33e2e28401d May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-DeleteServersTestJSON-1253958708-project May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.678406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '36adfbf4-6054-422d-9c0a-f71051437895'} May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:09:59.679094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.680159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.681258 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Returning 404 to user: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:09:59.681258 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7c18e54f-a73c-4d6e-87b4-3ecd64cb0b41 tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 404 len: 111 microversion: 2.1 time: 0.046141 May 26 15:09:59.682638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 71/134] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:09:59 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:09:59.813605 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:09:59.815117 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:09:59.822611 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.823313 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.824643 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.825288 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.852719 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] HTTP exception thrown: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Request method failure captured: May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895/os-volume_attachments HTTP/1.1 May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gCRukCFG22AouWB0Iyojq2zina17EMXdJeSTvStR41ZhVUVbsmnBsc8E3WSqjOIE6X3_yof2jKrE0_alpOmBDqFScqezh7uIqcRBWzHnUNBU7a23Jh-SnanTe8EaZiygbqjBsHlmMHgfBlFuHvK34F5RGdZBsuoEzGeXFLt8-EZAo May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: ac537167367948ef88587242df4e921d May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-DeleteServersTestJSON-1253958708 May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:09:59.855649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ac537167367948ef88587242df4e921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ac537167367948ef88587242df4e921d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ac537167367948ef88587242df4e921d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ac537167367948ef88587242df4e921d"}]}] May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-DeleteServersTestJSON-1253958708 May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: ac537167367948ef88587242df4e921d May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1253958708 May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-DeleteServersTestJSON-1253958708-project May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 166bfe89e44847d7b380f33e2e28401d May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-DeleteServersTestJSON-1253958708-project May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.856974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'server_id': '36adfbf4-6054-422d-9c0a-f71051437895'} May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:09:59.857753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:09:59.859024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:09:59.861549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Returning 404 to user: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:09:59.862645 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e29979b9-75a3-4843-92b2-d0b038a0c03a tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053147 May 26 15:09:59.863823 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 72/135] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:09:59 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:09:59.904044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:09:59.904541 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:09:59.905071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:09:59.911703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:09:59.912042 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:09:59.949041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.949536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:09:59.950360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:09:59.952956 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:00.008539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Getting quotas for project 664448e66c54440f909ae6727ccc3deb. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:10:00.017256 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Getting quotas for user 1c54e915f4014d58ba28d6e6d5dd6ab6 and project 664448e66c54440f909ae6727ccc3deb. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:10:00.043448 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:10:00.046612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:10:00.111199 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d01a81bc-588d-4dfd-a001-88e739548d02 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837645 May 26 15:10:00.117857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 64/136] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:10:00.124173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bcc63673-8994-4834-93f7-91bf30b50481 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:00.125082 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bcc63673-8994-4834-93f7-91bf30b50481 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:00.190974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bcc63673-8994-4834-93f7-91bf30b50481 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:00.200522 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bcc63673-8994-4834-93f7-91bf30b50481 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1213 microversion: 2.1 time: 0.081583 May 26 15:10:00.201113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 73/137] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:00 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:01.126510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:01.127231 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:01.138078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.138078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.139198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.140184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.155509 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] HTTP exception thrown: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Request method failure captured: May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 HTTP/1.1 May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gCRukCFG22AouWB0Iyojq2zina17EMXdJeSTvStR41ZhVUVbsmnBsc8E3WSqjOIE6X3_yof2jKrE0_alpOmBDqFScqezh7uIqcRBWzHnUNBU7a23Jh-SnanTe8EaZiygbqjBsHlmMHgfBlFuHvK34F5RGdZBsuoEzGeXFLt8-EZAo May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: ac537167367948ef88587242df4e921d May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-DeleteServersTestJSON-1253958708 May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:10:01.160573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ac537167367948ef88587242df4e921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ac537167367948ef88587242df4e921d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ac537167367948ef88587242df4e921d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ac537167367948ef88587242df4e921d"}]}] May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-DeleteServersTestJSON-1253958708 May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: ac537167367948ef88587242df4e921d May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-DeleteServersTestJSON-1253958708 May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-DeleteServersTestJSON-1253958708-project May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 166bfe89e44847d7b380f33e2e28401d May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-DeleteServersTestJSON-1253958708-project May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.162678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '36adfbf4-6054-422d-9c0a-f71051437895'} May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:01.163553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.164857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:10:01.166298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Returning 404 to user: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:01.166298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d05e13e2-8482-45ec-8946-2d96202e737c tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "DELETE /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 404 len: 111 microversion: 2.1 time: 0.042407 May 26 15:10:01.167121 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 65/138] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:10:01 2022] DELETE /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:01.175084 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:01.175690 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] [instance: 36adfbf4-6054-422d-9c0a-f71051437895] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:01.181800 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.182466 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.183941 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.184369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.203077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] HTTP exception thrown: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Request method failure captured: May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 HTTP/1.1 May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gCRukCFG22AouWB0Iyojq2zina17EMXdJeSTvStR41ZhVUVbsmnBsc8E3WSqjOIE6X3_yof2jKrE0_alpOmBDqFScqezh7uIqcRBWzHnUNBU7a23Jh-SnanTe8EaZiygbqjBsHlmMHgfBlFuHvK34F5RGdZBsuoEzGeXFLt8-EZAo May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: ac537167367948ef88587242df4e921d May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-DeleteServersTestJSON-1253958708 May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:10:01.205124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ac537167367948ef88587242df4e921d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ac537167367948ef88587242df4e921d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ac537167367948ef88587242df4e921d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ac537167367948ef88587242df4e921d"}]}] May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-DeleteServersTestJSON-1253958708 May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: ac537167367948ef88587242df4e921d May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-DeleteServersTestJSON-1253958708 May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-DeleteServersTestJSON-1253958708-project May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 166bfe89e44847d7b380f33e2e28401d May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-DeleteServersTestJSON-1253958708-project May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.206572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '36adfbf4-6054-422d-9c0a-f71051437895'} May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:01.207318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. May 26 15:10:01.208661 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:01.210679 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] Returning 404 to user: Instance 36adfbf4-6054-422d-9c0a-f71051437895 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:01.211734 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-47a94166-96f2-4137-aea0-dabdcf11788e tempest-DeleteServersTestJSON-1253958708 tempest-DeleteServersTestJSON-1253958708-project] 10.222.0.46 "GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895" status: 404 len: 111 microversion: 2.1 time: 0.040540 May 26 15:10:01.212295 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 74/139] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:01 2022] GET /compute/v2.1/servers/36adfbf4-6054-422d-9c0a-f71051437895 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:01.222485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-40192db0-df58-4c1d-8b70-51edcee10bb7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:01.223244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-40192db0-df58-4c1d-8b70-51edcee10bb7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:01.243729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40192db0-df58-4c1d-8b70-51edcee10bb7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.249539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40192db0-df58-4c1d-8b70-51edcee10bb7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.249539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40192db0-df58-4c1d-8b70-51edcee10bb7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:01.249539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40192db0-df58-4c1d-8b70-51edcee10bb7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:01.354150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-40192db0-df58-4c1d-8b70-51edcee10bb7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:01.362249 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-40192db0-df58-4c1d-8b70-51edcee10bb7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1265 microversion: 2.1 time: 0.144705 May 26 15:10:01.362797 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 66/140] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:01 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:02.380382 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0f675b57-d731-446b-ac8a-7f73a4d0fcb5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:02.382095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0f675b57-d731-446b-ac8a-7f73a4d0fcb5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:02.390841 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f675b57-d731-446b-ac8a-7f73a4d0fcb5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.391292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f675b57-d731-446b-ac8a-7f73a4d0fcb5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.392603 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f675b57-d731-446b-ac8a-7f73a4d0fcb5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:02.392900 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f675b57-d731-446b-ac8a-7f73a4d0fcb5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:02.487761 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0f675b57-d731-446b-ac8a-7f73a4d0fcb5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:02.496447 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0f675b57-d731-446b-ac8a-7f73a4d0fcb5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1271 microversion: 2.1 time: 0.119287 May 26 15:10:02.497128 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 75/141] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:02 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:03.514519 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2e22f461-cb4e-4dc5-8fc6-2585fbdb0692 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:03.515304 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2e22f461-cb4e-4dc5-8fc6-2585fbdb0692 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:03.521859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2e22f461-cb4e-4dc5-8fc6-2585fbdb0692 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:03.522307 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2e22f461-cb4e-4dc5-8fc6-2585fbdb0692 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:03.523078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2e22f461-cb4e-4dc5-8fc6-2585fbdb0692 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:03.523510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2e22f461-cb4e-4dc5-8fc6-2585fbdb0692 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:03.633897 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2e22f461-cb4e-4dc5-8fc6-2585fbdb0692 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:03.642241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2e22f461-cb4e-4dc5-8fc6-2585fbdb0692 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1271 microversion: 2.1 time: 0.131656 May 26 15:10:03.642827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 67/142] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:03 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:04.659336 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-24dd2020-e738-4489-a68c-c99358021d5c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:04.660667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-24dd2020-e738-4489-a68c-c99358021d5c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:04.668247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24dd2020-e738-4489-a68c-c99358021d5c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:04.669163 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24dd2020-e738-4489-a68c-c99358021d5c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:04.670343 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24dd2020-e738-4489-a68c-c99358021d5c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:04.671038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24dd2020-e738-4489-a68c-c99358021d5c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:04.788168 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-24dd2020-e738-4489-a68c-c99358021d5c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:04.799003 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-24dd2020-e738-4489-a68c-c99358021d5c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1271 microversion: 2.1 time: 0.143375 May 26 15:10:04.799686 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 76/143] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:04 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:05.824437 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7ad25cb1-c1a7-484a-bec6-e2d93865ba13 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:05.828043 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7ad25cb1-c1a7-484a-bec6-e2d93865ba13 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:05.859191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7ad25cb1-c1a7-484a-bec6-e2d93865ba13 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:05.860152 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7ad25cb1-c1a7-484a-bec6-e2d93865ba13 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:05.861266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7ad25cb1-c1a7-484a-bec6-e2d93865ba13 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:05.863200 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7ad25cb1-c1a7-484a-bec6-e2d93865ba13 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:06.162429 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-62961122-3932-4b83-bfe7-bc1ff9ca5905 req-6298ddc5-1e2d-4a95-b668-16ae8382db9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9741f3e9-dd12-42d7-b163-f643be0b668c", "tag": "290094a1-f00a-4efb-a5b3-f5ddf85f4336"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:06.179569 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-62961122-3932-4b83-bfe7-bc1ff9ca5905 req-6298ddc5-1e2d-4a95-b668-16ae8382db9f service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:06.180019 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-62961122-3932-4b83-bfe7-bc1ff9ca5905 req-6298ddc5-1e2d-4a95-b668-16ae8382db9f service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:06.381484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7ad25cb1-c1a7-484a-bec6-e2d93865ba13 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:06.396585 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7ad25cb1-c1a7-484a-bec6-e2d93865ba13 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1313 microversion: 2.1 time: 0.579074 May 26 15:10:06.397179 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 68/144] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:05 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:06.541774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-62961122-3932-4b83-bfe7-bc1ff9ca5905 req-6298ddc5-1e2d-4a95-b668-16ae8382db9f service nova] Creating event network-changed:290094a1-f00a-4efb-a5b3-f5ddf85f4336 for instance 9741f3e9-dd12-42d7-b163-f643be0b668c on hv-cinder-78836 May 26 15:10:06.549517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-62961122-3932-4b83-bfe7-bc1ff9ca5905 req-6298ddc5-1e2d-4a95-b668-16ae8382db9f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.390837 May 26 15:10:06.551399 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 77/145] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:07.414032 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a2410582-0355-4e56-9bc7-3c2862e11cbc tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:07.414657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a2410582-0355-4e56-9bc7-3c2862e11cbc tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:07.432436 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a2410582-0355-4e56-9bc7-3c2862e11cbc tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:07.432436 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a2410582-0355-4e56-9bc7-3c2862e11cbc tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:07.433923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a2410582-0355-4e56-9bc7-3c2862e11cbc tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:07.434382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a2410582-0355-4e56-9bc7-3c2862e11cbc tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:07.888818 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a2410582-0355-4e56-9bc7-3c2862e11cbc tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:07.897537 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a2410582-0355-4e56-9bc7-3c2862e11cbc tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1313 microversion: 2.1 time: 0.487649 May 26 15:10:07.898826 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 69/146] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:07 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:08.922320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-569d6cad-9379-4198-8b22-fe3f92a929a4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:08.923183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-569d6cad-9379-4198-8b22-fe3f92a929a4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:08.930796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-569d6cad-9379-4198-8b22-fe3f92a929a4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:08.931478 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-569d6cad-9379-4198-8b22-fe3f92a929a4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:08.933588 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-569d6cad-9379-4198-8b22-fe3f92a929a4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:08.934344 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-569d6cad-9379-4198-8b22-fe3f92a929a4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:09.181995 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-569d6cad-9379-4198-8b22-fe3f92a929a4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:09.192459 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-569d6cad-9379-4198-8b22-fe3f92a929a4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1313 microversion: 2.1 time: 0.276605 May 26 15:10:09.193046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 78/147] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:08 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:09.623331 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-608815220", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:09.681480 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] validate_networks() for [('8bf2593f-6b7e-48a8-9b32-aea452c29f00', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:10:09.977333 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:10.033996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:10.123776 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:10:10.124202 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:10:10.124865 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:10:10.125796 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:10:10.126217 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:10:10.144361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:10.144807 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:10.146098 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:10.146543 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:10.172603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Getting quotas for project 45e3fe61cc704411ac645e5935b9d258. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:10:10.178430 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Getting quotas for user 27172e53a12a437c9d57a75a95727d71 and project 45e3fe61cc704411ac645e5935b9d258. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:10:10.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:10:10.200518 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:10:10.209961 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-737e4f0c-1142-44ec-b8bc-759365524639 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:10.210767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-737e4f0c-1142-44ec-b8bc-759365524639 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:10.214305 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:10.218284 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-737e4f0c-1142-44ec-b8bc-759365524639 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:10.219073 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-737e4f0c-1142-44ec-b8bc-759365524639 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:10.219838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-737e4f0c-1142-44ec-b8bc-759365524639 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:10.220347 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-737e4f0c-1142-44ec-b8bc-759365524639 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:10.259417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-015df572-68df-474f-9e52-b73fb8d5cf9f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.797580 May 26 15:10:10.260734 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 70/148] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:10:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:10:10.274118 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d7558265-48c6-4f9b-b09b-110a5ebdde8d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:10.275459 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d7558265-48c6-4f9b-b09b-110a5ebdde8d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:10.380832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d7558265-48c6-4f9b-b09b-110a5ebdde8d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:10.395870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d7558265-48c6-4f9b-b09b-110a5ebdde8d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1221 microversion: 2.1 time: 0.124488 May 26 15:10:10.413908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 71/149] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:10 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:10.456619 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-737e4f0c-1142-44ec-b8bc-759365524639 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:10.468605 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-737e4f0c-1142-44ec-b8bc-759365524639 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1313 microversion: 2.1 time: 0.262413 May 26 15:10:10.469511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 79/150] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:10 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:10.587085 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1875427885", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:10.688026 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] validate_networks() for [('8bf2593f-6b7e-48a8-9b32-aea452c29f00', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:10:11.355846 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:10:11.356620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:10:11.359441 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:10:11.360028 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:10:11.360685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:10:11.377174 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:11.378589 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:11.382513 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:11.383825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:11.409445 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Getting quotas for project 45e3fe61cc704411ac645e5935b9d258. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:10:11.413796 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Getting quotas for user 27172e53a12a437c9d57a75a95727d71 and project 45e3fe61cc704411ac645e5935b9d258. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:10:11.426397 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:10:11.428788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:10:11.485924 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-99c3bda2-1df4-4ba3-9237-93fb3944a2cd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:11.487087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-99c3bda2-1df4-4ba3-9237-93fb3944a2cd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:11.501260 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-99c3bda2-1df4-4ba3-9237-93fb3944a2cd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:11.501986 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-99c3bda2-1df4-4ba3-9237-93fb3944a2cd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:11.502939 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-99c3bda2-1df4-4ba3-9237-93fb3944a2cd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:11.503536 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-99c3bda2-1df4-4ba3-9237-93fb3944a2cd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:11.510097 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-79cfa12e-53e0-43c4-810c-436eb24d748d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.932390 May 26 15:10:11.516726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 72/151] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:10:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:10:11.523334 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-becdf6e0-b19a-41b7-a419-e4a373eccd0b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:11.524407 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-becdf6e0-b19a-41b7-a419-e4a373eccd0b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:11.638176 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-becdf6e0-b19a-41b7-a419-e4a373eccd0b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:11.650839 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-becdf6e0-b19a-41b7-a419-e4a373eccd0b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1222 microversion: 2.1 time: 0.130709 May 26 15:10:11.663197 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 73/152] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:11 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1222 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:11.803411 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-99c3bda2-1df4-4ba3-9237-93fb3944a2cd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:11.814516 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-99c3bda2-1df4-4ba3-9237-93fb3944a2cd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1313 microversion: 2.1 time: 0.332431 May 26 15:10:11.817142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 80/153] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:11 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:12.672865 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7f5e86e3-b923-4da6-9ebb-e0c2e45f7778 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:12.674184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7f5e86e3-b923-4da6-9ebb-e0c2e45f7778 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:12.688568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7f5e86e3-b923-4da6-9ebb-e0c2e45f7778 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:12.689264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7f5e86e3-b923-4da6-9ebb-e0c2e45f7778 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:12.690959 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7f5e86e3-b923-4da6-9ebb-e0c2e45f7778 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:12.691628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7f5e86e3-b923-4da6-9ebb-e0c2e45f7778 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:12.843841 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-caa70049-6707-4df5-8aa1-4765dcc77d03 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:12.845053 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-caa70049-6707-4df5-8aa1-4765dcc77d03 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:12.852302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-caa70049-6707-4df5-8aa1-4765dcc77d03 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:12.852990 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-caa70049-6707-4df5-8aa1-4765dcc77d03 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:12.854851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-caa70049-6707-4df5-8aa1-4765dcc77d03 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:12.855450 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-caa70049-6707-4df5-8aa1-4765dcc77d03 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:12.864944 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7f5e86e3-b923-4da6-9ebb-e0c2e45f7778 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:12.877736 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7f5e86e3-b923-4da6-9ebb-e0c2e45f7778 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1274 microversion: 2.1 time: 0.208703 May 26 15:10:12.882166 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 74/154] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:12 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:13.204306 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-caa70049-6707-4df5-8aa1-4765dcc77d03 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:13.222432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-caa70049-6707-4df5-8aa1-4765dcc77d03 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1313 microversion: 2.1 time: 0.387009 May 26 15:10:13.223054 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 81/155] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:12 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:13.904161 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b190e7f9-e07e-471c-b30d-79433e7e08da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:13.906756 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b190e7f9-e07e-471c-b30d-79433e7e08da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:13.918815 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b190e7f9-e07e-471c-b30d-79433e7e08da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:13.919938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b190e7f9-e07e-471c-b30d-79433e7e08da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:13.921489 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b190e7f9-e07e-471c-b30d-79433e7e08da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:13.924512 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b190e7f9-e07e-471c-b30d-79433e7e08da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:14.127610 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b190e7f9-e07e-471c-b30d-79433e7e08da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:14.138627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b190e7f9-e07e-471c-b30d-79433e7e08da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1280 microversion: 2.1 time: 0.242983 May 26 15:10:14.140140 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-89ab5866-d179-4820-89a1-17b6c16a5840 req-e50119e8-1da0-4eb0-b1b3-f321009528d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741f3e9-dd12-42d7-b163-f643be0b668c", "name": "network-vif-plugged", "status": "completed", "tag": "290094a1-f00a-4efb-a5b3-f5ddf85f4336"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:14.152471 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 75/156] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:13 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:14.158101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-89ab5866-d179-4820-89a1-17b6c16a5840 req-e50119e8-1da0-4eb0-b1b3-f321009528d3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:14.158493 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-89ab5866-d179-4820-89a1-17b6c16a5840 req-e50119e8-1da0-4eb0-b1b3-f321009528d3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:14.199267 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-89ab5866-d179-4820-89a1-17b6c16a5840 req-e50119e8-1da0-4eb0-b1b3-f321009528d3 service nova] Creating event network-vif-plugged:290094a1-f00a-4efb-a5b3-f5ddf85f4336 for instance 9741f3e9-dd12-42d7-b163-f643be0b668c on hv-cinder-78836 May 26 15:10:14.208946 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-89ab5866-d179-4820-89a1-17b6c16a5840 req-e50119e8-1da0-4eb0-b1b3-f321009528d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074433 May 26 15:10:14.210193 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 82/157] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:14.239782 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a6ed14a8-ba19-42e1-8e5b-0c14faf491e7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:14.240474 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a6ed14a8-ba19-42e1-8e5b-0c14faf491e7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:14.249523 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6ed14a8-ba19-42e1-8e5b-0c14faf491e7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:14.249856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6ed14a8-ba19-42e1-8e5b-0c14faf491e7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:14.256653 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6ed14a8-ba19-42e1-8e5b-0c14faf491e7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:14.257116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6ed14a8-ba19-42e1-8e5b-0c14faf491e7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:14.490275 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a6ed14a8-ba19-42e1-8e5b-0c14faf491e7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:14.507484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a6ed14a8-ba19-42e1-8e5b-0c14faf491e7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1313 microversion: 2.1 time: 0.270398 May 26 15:10:14.509811 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 76/158] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:14 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:15.157260 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-43e4a6a5-977f-47c2-9860-629ec78122fd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:15.158645 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-43e4a6a5-977f-47c2-9860-629ec78122fd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:15.165412 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-43e4a6a5-977f-47c2-9860-629ec78122fd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:15.165892 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-43e4a6a5-977f-47c2-9860-629ec78122fd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:15.166732 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-43e4a6a5-977f-47c2-9860-629ec78122fd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:15.167180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-43e4a6a5-977f-47c2-9860-629ec78122fd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:15.421866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-43e4a6a5-977f-47c2-9860-629ec78122fd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:15.432048 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-43e4a6a5-977f-47c2-9860-629ec78122fd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.277237 May 26 15:10:15.436868 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 83/159] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:15 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:15.529191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5f7ff190-60aa-43ed-974a-374ebc05c9d9 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:15.530922 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5f7ff190-60aa-43ed-974a-374ebc05c9d9 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:15.547139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f7ff190-60aa-43ed-974a-374ebc05c9d9 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:15.547601 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f7ff190-60aa-43ed-974a-374ebc05c9d9 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:15.548585 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f7ff190-60aa-43ed-974a-374ebc05c9d9 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:15.549023 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5f7ff190-60aa-43ed-974a-374ebc05c9d9 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:15.821542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5f7ff190-60aa-43ed-974a-374ebc05c9d9 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:15.841174 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5f7ff190-60aa-43ed-974a-374ebc05c9d9 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1313 microversion: 2.1 time: 0.317563 May 26 15:10:15.841808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 77/160] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:15 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:16.413740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-9da13fbc-3cd2-42a9-99db-95ddaf898f3d req-dedfb763-40aa-4e9a-a76a-025b71295815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef06b3f7-244b-42fd-8657-59708a3b66f5", "tag": "3b0d0eff-4509-4ba8-a8f0-305d4896d23f"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:16.429794 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-9da13fbc-3cd2-42a9-99db-95ddaf898f3d req-dedfb763-40aa-4e9a-a76a-025b71295815 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.433687 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-9da13fbc-3cd2-42a9-99db-95ddaf898f3d req-dedfb763-40aa-4e9a-a76a-025b71295815 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:16.450377 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6c4330d7-cd17-42b8-b646-c7879d45e7c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:16.455548 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6c4330d7-cd17-42b8-b646-c7879d45e7c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:16.462397 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-9da13fbc-3cd2-42a9-99db-95ddaf898f3d req-dedfb763-40aa-4e9a-a76a-025b71295815 service nova] Creating event network-changed:3b0d0eff-4509-4ba8-a8f0-305d4896d23f for instance ef06b3f7-244b-42fd-8657-59708a3b66f5 on hv-cinder-78836 May 26 15:10:16.472054 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c4330d7-cd17-42b8-b646-c7879d45e7c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.474005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c4330d7-cd17-42b8-b646-c7879d45e7c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:16.476116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c4330d7-cd17-42b8-b646-c7879d45e7c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.476589 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c4330d7-cd17-42b8-b646-c7879d45e7c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:16.487366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-9da13fbc-3cd2-42a9-99db-95ddaf898f3d req-dedfb763-40aa-4e9a-a76a-025b71295815 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078865 May 26 15:10:16.487973 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 84/161] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:16.852648 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6c4330d7-cd17-42b8-b646-c7879d45e7c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:16.865847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ae3e1f5c-8c0b-486b-b286-8b23c06fac6d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:16.867365 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ae3e1f5c-8c0b-486b-b286-8b23c06fac6d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:16.876320 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6c4330d7-cd17-42b8-b646-c7879d45e7c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.430591 May 26 15:10:16.877235 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ae3e1f5c-8c0b-486b-b286-8b23c06fac6d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.878013 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ae3e1f5c-8c0b-486b-b286-8b23c06fac6d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:16.879225 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ae3e1f5c-8c0b-486b-b286-8b23c06fac6d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:16.880365 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ae3e1f5c-8c0b-486b-b286-8b23c06fac6d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:16.884690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 78/162] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:16 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:17.492865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ae3e1f5c-8c0b-486b-b286-8b23c06fac6d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:17.503152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ae3e1f5c-8c0b-486b-b286-8b23c06fac6d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1496 microversion: 2.1 time: 0.645326 May 26 15:10:17.510230 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 85/163] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:16 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1496 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:17.910858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8c10033a-626b-4f72-a2be-2d23362e7202 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:17.911543 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8c10033a-626b-4f72-a2be-2d23362e7202 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:17.914345 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:17.923059 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c10033a-626b-4f72-a2be-2d23362e7202 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:17.923802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c10033a-626b-4f72-a2be-2d23362e7202 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:17.924761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c10033a-626b-4f72-a2be-2d23362e7202 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:17.925207 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c10033a-626b-4f72-a2be-2d23362e7202 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.079055 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8c10033a-626b-4f72-a2be-2d23362e7202 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:18.089985 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8c10033a-626b-4f72-a2be-2d23362e7202 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.182632 May 26 15:10:18.090765 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 79/164] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:17 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:18.526288 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-1cfc3bf1-c899-4a34-8c53-4a55764f2585 req-254d03ba-0d31-49f1-b095-1c106e5c0867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240f19f3-04d8-4c10-a376-0f18377ee00a", "tag": "dc0d1f46-3f16-4656-8246-5fefd8f4774a"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:18.540167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-1cfc3bf1-c899-4a34-8c53-4a55764f2585 req-254d03ba-0d31-49f1-b095-1c106e5c0867 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.540954 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-1cfc3bf1-c899-4a34-8c53-4a55764f2585 req-254d03ba-0d31-49f1-b095-1c106e5c0867 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.560679 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-1cfc3bf1-c899-4a34-8c53-4a55764f2585 req-254d03ba-0d31-49f1-b095-1c106e5c0867 service nova] Creating event network-changed:dc0d1f46-3f16-4656-8246-5fefd8f4774a for instance 240f19f3-04d8-4c10-a376-0f18377ee00a on hv-cinder-78836 May 26 15:10:18.568480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-1cfc3bf1-c899-4a34-8c53-4a55764f2585 req-254d03ba-0d31-49f1-b095-1c106e5c0867 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045736 May 26 15:10:18.569588 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 86/165] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:18.694031 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3568a14f-4bc2-48e2-859b-0033448401ee tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:18.694821 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3568a14f-4bc2-48e2-859b-0033448401ee tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:18.703506 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3568a14f-4bc2-48e2-859b-0033448401ee tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.703953 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3568a14f-4bc2-48e2-859b-0033448401ee tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.704915 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3568a14f-4bc2-48e2-859b-0033448401ee tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.705341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3568a14f-4bc2-48e2-859b-0033448401ee tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.738603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3568a14f-4bc2-48e2-859b-0033448401ee tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:10:18.853767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3568a14f-4bc2-48e2-859b-0033448401ee tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 204 len: 0 microversion: 2.1 time: 0.163320 May 26 15:10:18.855043 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 80/166] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:10:18 2022] DELETE /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:10:18.865955 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f6e7af1d-c34a-4145-8e10-b1f95c849c94 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:18.866683 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f6e7af1d-c34a-4145-8e10-b1f95c849c94 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:18.874526 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f6e7af1d-c34a-4145-8e10-b1f95c849c94 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.875092 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f6e7af1d-c34a-4145-8e10-b1f95c849c94 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:18.876010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f6e7af1d-c34a-4145-8e10-b1f95c849c94 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:18.876842 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f6e7af1d-c34a-4145-8e10-b1f95c849c94 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:19.060743 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f6e7af1d-c34a-4145-8e10-b1f95c849c94 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:19.074139 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f6e7af1d-c34a-4145-8e10-b1f95c849c94 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1502 microversion: 2.1 time: 0.212873 May 26 15:10:19.075627 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 87/167] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:18 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:19.109428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8248c90a-704c-45dc-ab9c-0dac3f0bcc9d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:19.111035 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8248c90a-704c-45dc-ab9c-0dac3f0bcc9d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:19.127280 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8248c90a-704c-45dc-ab9c-0dac3f0bcc9d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:19.127747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8248c90a-704c-45dc-ab9c-0dac3f0bcc9d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:19.128585 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8248c90a-704c-45dc-ab9c-0dac3f0bcc9d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:19.129000 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8248c90a-704c-45dc-ab9c-0dac3f0bcc9d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:19.136998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:19.390395 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8248c90a-704c-45dc-ab9c-0dac3f0bcc9d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:19.399313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8248c90a-704c-45dc-ab9c-0dac3f0bcc9d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.294700 May 26 15:10:19.399994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 81/168] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:19 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:20.095106 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3c198db3-4705-45d4-a6e5-66b75990c1bd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:20.095876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3c198db3-4705-45d4-a6e5-66b75990c1bd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:20.103046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c198db3-4705-45d4-a6e5-66b75990c1bd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:20.103769 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c198db3-4705-45d4-a6e5-66b75990c1bd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:20.104774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c198db3-4705-45d4-a6e5-66b75990c1bd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:20.105403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c198db3-4705-45d4-a6e5-66b75990c1bd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:20.263238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3c198db3-4705-45d4-a6e5-66b75990c1bd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:20.271570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3c198db3-4705-45d4-a6e5-66b75990c1bd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1502 microversion: 2.1 time: 0.183127 May 26 15:10:20.272256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 88/169] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:20 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:20.419404 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-70d77614-b234-44d3-b3cb-5a10fa8abeda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:20.421919 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-70d77614-b234-44d3-b3cb-5a10fa8abeda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:20.429897 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70d77614-b234-44d3-b3cb-5a10fa8abeda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:20.430360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70d77614-b234-44d3-b3cb-5a10fa8abeda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:20.431379 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70d77614-b234-44d3-b3cb-5a10fa8abeda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:20.431830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70d77614-b234-44d3-b3cb-5a10fa8abeda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:20.583330 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-70d77614-b234-44d3-b3cb-5a10fa8abeda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:20.593100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-70d77614-b234-44d3-b3cb-5a10fa8abeda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.177788 May 26 15:10:20.593930 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 82/170] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:20 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:21.288385 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-95d28776-0ab6-42b1-b35f-e283017efe55 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:21.289021 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-95d28776-0ab6-42b1-b35f-e283017efe55 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:21.300566 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95d28776-0ab6-42b1-b35f-e283017efe55 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:21.301014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95d28776-0ab6-42b1-b35f-e283017efe55 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:21.301827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95d28776-0ab6-42b1-b35f-e283017efe55 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:21.302269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95d28776-0ab6-42b1-b35f-e283017efe55 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:21.442762 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-95d28776-0ab6-42b1-b35f-e283017efe55 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:21.451154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-95d28776-0ab6-42b1-b35f-e283017efe55 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1502 microversion: 2.1 time: 0.166858 May 26 15:10:21.451745 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 89/171] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:21 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:21.610113 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-96da7e94-deca-4f52-b788-d8ce9ac220c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:21.610788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-96da7e94-deca-4f52-b788-d8ce9ac220c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:21.612904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=4 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:21.618698 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-96da7e94-deca-4f52-b788-d8ce9ac220c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:21.619158 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-96da7e94-deca-4f52-b788-d8ce9ac220c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:21.619963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-96da7e94-deca-4f52-b788-d8ce9ac220c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:21.620410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-96da7e94-deca-4f52-b788-d8ce9ac220c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:21.643542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=16 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:21.755721 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-96da7e94-deca-4f52-b788-d8ce9ac220c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:21.763690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-96da7e94-deca-4f52-b788-d8ce9ac220c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.157507 May 26 15:10:21.764258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 83/172] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:21 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:22.473057 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-04a09a2e-8e65-42d3-b8d0-4f095cbeba6c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:22.474280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-04a09a2e-8e65-42d3-b8d0-4f095cbeba6c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:22.481384 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-04a09a2e-8e65-42d3-b8d0-4f095cbeba6c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:22.481897 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-04a09a2e-8e65-42d3-b8d0-4f095cbeba6c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:22.482738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-04a09a2e-8e65-42d3-b8d0-4f095cbeba6c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:22.483361 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-04a09a2e-8e65-42d3-b8d0-4f095cbeba6c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:22.626810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-04a09a2e-8e65-42d3-b8d0-4f095cbeba6c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:22.638864 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-04a09a2e-8e65-42d3-b8d0-4f095cbeba6c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1502 microversion: 2.1 time: 0.173860 May 26 15:10:22.640626 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 90/173] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:22 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:22.783582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4c3cf7b1-ba14-4a1c-9727-f854e5386fbd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:22.785073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4c3cf7b1-ba14-4a1c-9727-f854e5386fbd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:22.792408 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c3cf7b1-ba14-4a1c-9727-f854e5386fbd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:22.792859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c3cf7b1-ba14-4a1c-9727-f854e5386fbd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:22.793981 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c3cf7b1-ba14-4a1c-9727-f854e5386fbd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:22.794642 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c3cf7b1-ba14-4a1c-9727-f854e5386fbd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.034538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4c3cf7b1-ba14-4a1c-9727-f854e5386fbd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:23.043234 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4c3cf7b1-ba14-4a1c-9727-f854e5386fbd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.265599 May 26 15:10:23.043923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 84/174] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:22 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:23.311308 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-916c3157-49e7-4b1c-af09-41878c15f002 req-62a1cfa3-4832-4198-b3e8-909aa48d087d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9741f3e9-dd12-42d7-b163-f643be0b668c", "name": "network-vif-deleted", "tag": "290094a1-f00a-4efb-a5b3-f5ddf85f4336"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:23.315137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=54 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:23.322194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-916c3157-49e7-4b1c-af09-41878c15f002 req-62a1cfa3-4832-4198-b3e8-909aa48d087d service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:23.323165 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-916c3157-49e7-4b1c-af09-41878c15f002 req-62a1cfa3-4832-4198-b3e8-909aa48d087d service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.335097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-916c3157-49e7-4b1c-af09-41878c15f002 req-62a1cfa3-4832-4198-b3e8-909aa48d087d service nova] Creating event network-vif-deleted:290094a1-f00a-4efb-a5b3-f5ddf85f4336 for instance 9741f3e9-dd12-42d7-b163-f643be0b668c on hv-cinder-78836 May 26 15:10:23.347142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-916c3157-49e7-4b1c-af09-41878c15f002 req-62a1cfa3-4832-4198-b3e8-909aa48d087d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039419 May 26 15:10:23.347957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 91/175] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:23.659947 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2588f8c8-0921-46ce-8e34-9d32a82f8e7d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:23.660566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2588f8c8-0921-46ce-8e34-9d32a82f8e7d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:23.666686 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2588f8c8-0921-46ce-8e34-9d32a82f8e7d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:23.667140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2588f8c8-0921-46ce-8e34-9d32a82f8e7d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.667907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2588f8c8-0921-46ce-8e34-9d32a82f8e7d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:23.668347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2588f8c8-0921-46ce-8e34-9d32a82f8e7d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:23.733273 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2588f8c8-0921-46ce-8e34-9d32a82f8e7d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:23.740740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2588f8c8-0921-46ce-8e34-9d32a82f8e7d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1460 microversion: 2.1 time: 0.087350 May 26 15:10:23.741312 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 85/176] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:23 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1460 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:24.061707 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c31f932b-74be-4b0b-8ef8-d69e9e270f44 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:24.062706 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c31f932b-74be-4b0b-8ef8-d69e9e270f44 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:24.069037 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c31f932b-74be-4b0b-8ef8-d69e9e270f44 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.069521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c31f932b-74be-4b0b-8ef8-d69e9e270f44 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.070303 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c31f932b-74be-4b0b-8ef8-d69e9e270f44 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.070741 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c31f932b-74be-4b0b-8ef8-d69e9e270f44 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.201149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c31f932b-74be-4b0b-8ef8-d69e9e270f44 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:24.208647 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c31f932b-74be-4b0b-8ef8-d69e9e270f44 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.151829 May 26 15:10:24.209210 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 92/177] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:24 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:24.760766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-96b5dbfe-3a8f-42e9-b7d8-a4299ea98d1d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:24.761631 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-96b5dbfe-3a8f-42e9-b7d8-a4299ea98d1d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:24.769023 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-96b5dbfe-3a8f-42e9-b7d8-a4299ea98d1d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.769659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-96b5dbfe-3a8f-42e9-b7d8-a4299ea98d1d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.770953 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-96b5dbfe-3a8f-42e9-b7d8-a4299ea98d1d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:24.771592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-96b5dbfe-3a8f-42e9-b7d8-a4299ea98d1d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:24.837737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-96b5dbfe-3a8f-42e9-b7d8-a4299ea98d1d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:24.847250 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-96b5dbfe-3a8f-42e9-b7d8-a4299ea98d1d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1460 microversion: 2.1 time: 0.090844 May 26 15:10:24.847831 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 86/178] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:24 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1460 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:25.225559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d23313f8-1746-4f70-842c-b95798e5ab1a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:25.226104 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d23313f8-1746-4f70-842c-b95798e5ab1a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:25.232693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d23313f8-1746-4f70-842c-b95798e5ab1a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.233140 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d23313f8-1746-4f70-842c-b95798e5ab1a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.234184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d23313f8-1746-4f70-842c-b95798e5ab1a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.234627 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d23313f8-1746-4f70-842c-b95798e5ab1a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.256272 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:25.392127 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d23313f8-1746-4f70-842c-b95798e5ab1a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:25.401931 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d23313f8-1746-4f70-842c-b95798e5ab1a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.180496 May 26 15:10:25.402509 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 93/179] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:25 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:25.868189 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-eb264903-bac6-4325-9a8e-f343762daebd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:25.869288 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-eb264903-bac6-4325-9a8e-f343762daebd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:25.876062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eb264903-bac6-4325-9a8e-f343762daebd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.876515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eb264903-bac6-4325-9a8e-f343762daebd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.877304 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eb264903-bac6-4325-9a8e-f343762daebd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:25.877769 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eb264903-bac6-4325-9a8e-f343762daebd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:25.945163 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-eb264903-bac6-4325-9a8e-f343762daebd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:25.953401 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-eb264903-bac6-4325-9a8e-f343762daebd tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1460 microversion: 2.1 time: 0.089093 May 26 15:10:25.954109 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 87/180] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:25 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1460 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:26.419290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1557c971-754c-4ab0-821b-63c3ded01b4d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:26.419905 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1557c971-754c-4ab0-821b-63c3ded01b4d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:26.426380 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1557c971-754c-4ab0-821b-63c3ded01b4d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:26.426868 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1557c971-754c-4ab0-821b-63c3ded01b4d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:26.427605 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1557c971-754c-4ab0-821b-63c3ded01b4d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:26.428080 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1557c971-754c-4ab0-821b-63c3ded01b4d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:26.570263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1557c971-754c-4ab0-821b-63c3ded01b4d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:26.580245 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1557c971-754c-4ab0-821b-63c3ded01b4d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.165016 May 26 15:10:26.580939 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 94/181] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:26 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:26.709115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-b9cbdb6f-60bc-4727-a74a-1c66524231ad req-12222789-707d-4da5-a062-1824ae7cb8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef06b3f7-244b-42fd-8657-59708a3b66f5", "name": "network-vif-plugged", "status": "completed", "tag": "3b0d0eff-4509-4ba8-a8f0-305d4896d23f"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:26.720842 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b9cbdb6f-60bc-4727-a74a-1c66524231ad req-12222789-707d-4da5-a062-1824ae7cb8d3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:26.721653 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b9cbdb6f-60bc-4727-a74a-1c66524231ad req-12222789-707d-4da5-a062-1824ae7cb8d3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:26.742448 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-b9cbdb6f-60bc-4727-a74a-1c66524231ad req-12222789-707d-4da5-a062-1824ae7cb8d3 service nova] Creating event network-vif-plugged:3b0d0eff-4509-4ba8-a8f0-305d4896d23f for instance ef06b3f7-244b-42fd-8657-59708a3b66f5 on hv-cinder-78836 May 26 15:10:26.750439 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-b9cbdb6f-60bc-4727-a74a-1c66524231ad req-12222789-707d-4da5-a062-1824ae7cb8d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045063 May 26 15:10:26.751255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 88/182] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:10:26.973740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:26.974795 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:26.982216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:26.982899 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:26.983943 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:26.984530 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:27.026255 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:27.026554 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:27.027075 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lazy-loading 'fault' on Instance uuid 9741f3e9-dd12-42d7-b163-f643be0b668c {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:27.088237 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:27.107343 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-53e62e22-42ad-4ae1-9f99-6d7fb5a922f4 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 200 len: 1303 microversion: 2.1 time: 0.140158 May 26 15:10:27.107925 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 95/183] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:26 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:27.598025 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b9af6fa9-39c4-4499-b15c-1c54512f35f3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:27.598829 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b9af6fa9-39c4-4499-b15c-1c54512f35f3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:27.607224 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9af6fa9-39c4-4499-b15c-1c54512f35f3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:27.607729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9af6fa9-39c4-4499-b15c-1c54512f35f3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:27.608443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9af6fa9-39c4-4499-b15c-1c54512f35f3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:27.608880 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9af6fa9-39c4-4499-b15c-1c54512f35f3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:27.747476 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b9af6fa9-39c4-4499-b15c-1c54512f35f3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:27.755888 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b9af6fa9-39c4-4499-b15c-1c54512f35f3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.162255 May 26 15:10:27.756564 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 89/184] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:27 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:28.127462 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:28.128695 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: 9741f3e9-dd12-42d7-b163-f643be0b668c] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:28.134853 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:28.135308 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:28.136112 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:28.136547 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:28.152130 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] HTTP exception thrown: Instance 9741f3e9-dd12-42d7-b163-f643be0b668c could not be found. May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Request method failure captured: May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c HTTP/1.1 May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5hETjcL5MwtiErjV9QHEAZ9mneDZHoVvEKPBLAk4u1eW53WSNYb10CMtuO1qPKTn9Fb9Qi1fjE70H0C6sa8sUnCmyxPUOYFAWdFSimCQq-Ijd7to3_jwT93vJ9AS3JR9twD-0KOlUdUvZlDmL_KsdeqlH9jDNyUwf93xS3YyduPkNo May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 664448e66c54440f909ae6727ccc3deb May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesActionsTest-1583638605 May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:10:28.155089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/664448e66c54440f909ae6727ccc3deb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/664448e66c54440f909ae6727ccc3deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_664448e66c54440f909ae6727ccc3deb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/664448e66c54440f909ae6727ccc3deb"}]}] May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesActionsTest-1583638605 May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 664448e66c54440f909ae6727ccc3deb May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesActionsTest-1583638605 May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesActionsTest-1583638605-project May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 1c54e915f4014d58ba28d6e6d5dd6ab6 May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesActionsTest-1583638605-project May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 9741f3e9-dd12-42d7-b163-f643be0b668c could not be found. May 26 15:10:28.156869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '9741f3e9-dd12-42d7-b163-f643be0b668c'} May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9741f3e9-dd12-42d7-b163-f643be0b668c could not be found. May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:28.158177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9741f3e9-dd12-42d7-b163-f643be0b668c could not be found. May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9741f3e9-dd12-42d7-b163-f643be0b668c could not be found. May 26 15:10:28.159873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:28.161166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Returning 404 to user: Instance 9741f3e9-dd12-42d7-b163-f643be0b668c could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:28.161166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-65930718-0b30-4c17-9dfe-a23dd7f33403 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c" status: 404 len: 111 microversion: 2.1 time: 0.035656 May 26 15:10:28.161166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 96/185] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:28 2022] GET /compute/v2.1/servers/9741f3e9-dd12-42d7-b163-f643be0b668c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:10:28.259239 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1736065833", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "networks": [{"uuid": "20da5449-4dfc-42c3-9de2-12d598d13a52"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:28.323373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] validate_networks() for [('20da5449-4dfc-42c3-9de2-12d598d13a52', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:10:28.717534 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:10:28.718202 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:10:28.718676 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:10:28.719215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:10:28.719807 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:10:28.730439 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:28.730891 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:28.731694 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:28.732132 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:28.748820 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Getting quotas for project 664448e66c54440f909ae6727ccc3deb. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:10:28.753054 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Getting quotas for user 1c54e915f4014d58ba28d6e6d5dd6ab6 and project 664448e66c54440f909ae6727ccc3deb. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:10:28.764087 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:10:28.766396 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:10:28.773340 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9f559d95-cbbe-49c6-8b6c-41f4008218f0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:28.774077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9f559d95-cbbe-49c6-8b6c-41f4008218f0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:28.780882 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9f559d95-cbbe-49c6-8b6c-41f4008218f0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:28.781335 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9f559d95-cbbe-49c6-8b6c-41f4008218f0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:28.782133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9f559d95-cbbe-49c6-8b6c-41f4008218f0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:28.782571 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9f559d95-cbbe-49c6-8b6c-41f4008218f0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:28.818503 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-455b69e9-fb8c-400d-8b18-2543d1fe48f8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563001 May 26 15:10:28.819478 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 90/186] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:10:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:10:28.829514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-23100a69-1e21-466d-8220-ceb1465f2f0f tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:28.830133 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-23100a69-1e21-466d-8220-ceb1465f2f0f tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:28.917734 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-23100a69-1e21-466d-8220-ceb1465f2f0f tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:28.929220 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-23100a69-1e21-466d-8220-ceb1465f2f0f tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1214 microversion: 2.1 time: 0.103649 May 26 15:10:28.930027 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 91/187] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:28 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:28.948720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9f559d95-cbbe-49c6-8b6c-41f4008218f0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:28.956785 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9f559d95-cbbe-49c6-8b6c-41f4008218f0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.187257 May 26 15:10:28.957348 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 97/188] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:28 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:29.947248 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4ef0c292-8f05-4387-afbe-0c5e1c9dfe80 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:29.947945 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4ef0c292-8f05-4387-afbe-0c5e1c9dfe80 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:29.956223 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ef0c292-8f05-4387-afbe-0c5e1c9dfe80 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:29.956868 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ef0c292-8f05-4387-afbe-0c5e1c9dfe80 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:29.957963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ef0c292-8f05-4387-afbe-0c5e1c9dfe80 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:29.958413 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ef0c292-8f05-4387-afbe-0c5e1c9dfe80 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:29.973171 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c7874986-040b-4ca3-8178-4811fee981a3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:29.973825 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c7874986-040b-4ca3-8178-4811fee981a3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:29.981014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7874986-040b-4ca3-8178-4811fee981a3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:29.981587 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7874986-040b-4ca3-8178-4811fee981a3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:29.982366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7874986-040b-4ca3-8178-4811fee981a3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:29.983667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7874986-040b-4ca3-8178-4811fee981a3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:30.029258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4ef0c292-8f05-4387-afbe-0c5e1c9dfe80 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:30.037758 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4ef0c292-8f05-4387-afbe-0c5e1c9dfe80 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1218 microversion: 2.1 time: 0.094712 May 26 15:10:30.038666 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 92/189] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:29 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:30.136727 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c7874986-040b-4ca3-8178-4811fee981a3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:30.144521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c7874986-040b-4ca3-8178-4811fee981a3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.175282 May 26 15:10:30.145102 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 98/190] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:29 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:30.302845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-542507c8-5ad9-4a96-aa98-a94d3687a214 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:30.303344 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-542507c8-5ad9-4a96-aa98-a94d3687a214 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:30.310026 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-542507c8-5ad9-4a96-aa98-a94d3687a214 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:30.310482 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-542507c8-5ad9-4a96-aa98-a94d3687a214 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:30.311247 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-542507c8-5ad9-4a96-aa98-a94d3687a214 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:30.311687 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-542507c8-5ad9-4a96-aa98-a94d3687a214 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:30.335048 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-542507c8-5ad9-4a96-aa98-a94d3687a214 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/ips" status: 200 len: 151 microversion: 2.20 time: 0.036108 May 26 15:10:30.335625 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 93/191] 10.222.0.46 () {60 vars in 1288 bytes} [Thu May 26 15:10:30 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:10:31.055880 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a4b1d1ba-192a-4303-bbf7-4a867dd58333 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:31.056494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a4b1d1ba-192a-4303-bbf7-4a867dd58333 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:31.063085 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4b1d1ba-192a-4303-bbf7-4a867dd58333 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:31.063535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4b1d1ba-192a-4303-bbf7-4a867dd58333 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:31.064290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4b1d1ba-192a-4303-bbf7-4a867dd58333 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:31.064723 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4b1d1ba-192a-4303-bbf7-4a867dd58333 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:31.145999 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a4b1d1ba-192a-4303-bbf7-4a867dd58333 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:31.155746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a4b1d1ba-192a-4303-bbf7-4a867dd58333 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1218 microversion: 2.1 time: 0.103532 May 26 15:10:31.157213 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 99/192] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:31 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:31.167652 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-44d9ade0-e4ed-4dfa-8058-3f595a2e7f5a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:31.169619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-44d9ade0-e4ed-4dfa-8058-3f595a2e7f5a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:31.186463 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44d9ade0-e4ed-4dfa-8058-3f595a2e7f5a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:31.186960 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44d9ade0-e4ed-4dfa-8058-3f595a2e7f5a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:31.187734 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44d9ade0-e4ed-4dfa-8058-3f595a2e7f5a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:31.188351 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44d9ade0-e4ed-4dfa-8058-3f595a2e7f5a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:31.506051 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-44d9ade0-e4ed-4dfa-8058-3f595a2e7f5a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:31.513571 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-44d9ade0-e4ed-4dfa-8058-3f595a2e7f5a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.353689 May 26 15:10:31.514251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 94/193] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:31 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:32.175140 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c13802b6-fd3a-4569-9fb8-2bd7d68634c8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:32.176647 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c13802b6-fd3a-4569-9fb8-2bd7d68634c8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:32.186613 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c13802b6-fd3a-4569-9fb8-2bd7d68634c8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:32.187438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c13802b6-fd3a-4569-9fb8-2bd7d68634c8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:32.188625 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c13802b6-fd3a-4569-9fb8-2bd7d68634c8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:32.189227 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c13802b6-fd3a-4569-9fb8-2bd7d68634c8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:32.265669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c13802b6-fd3a-4569-9fb8-2bd7d68634c8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:32.276075 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c13802b6-fd3a-4569-9fb8-2bd7d68634c8 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1266 microversion: 2.1 time: 0.106507 May 26 15:10:32.286393 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 100/194] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:32 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:32.532819 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-02d4b30b-9ea7-4f79-aedb-fcf7e9393dd1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:32.533662 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-02d4b30b-9ea7-4f79-aedb-fcf7e9393dd1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:32.541938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-02d4b30b-9ea7-4f79-aedb-fcf7e9393dd1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:32.542573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-02d4b30b-9ea7-4f79-aedb-fcf7e9393dd1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:32.543999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-02d4b30b-9ea7-4f79-aedb-fcf7e9393dd1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:32.544526 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-02d4b30b-9ea7-4f79-aedb-fcf7e9393dd1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:32.812116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-02d4b30b-9ea7-4f79-aedb-fcf7e9393dd1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:32.830089 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-02d4b30b-9ea7-4f79-aedb-fcf7e9393dd1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.300905 May 26 15:10:32.831246 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 95/195] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:32 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:33.135250 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-fee4f9d0-0b86-4012-83fc-3ed3689a464f req-affe23c8-9230-4184-9157-0683aa776d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240f19f3-04d8-4c10-a376-0f18377ee00a", "name": "network-vif-plugged", "status": "completed", "tag": "dc0d1f46-3f16-4656-8246-5fefd8f4774a"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:33.153594 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-fee4f9d0-0b86-4012-83fc-3ed3689a464f req-affe23c8-9230-4184-9157-0683aa776d41 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:33.154519 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-fee4f9d0-0b86-4012-83fc-3ed3689a464f req-affe23c8-9230-4184-9157-0683aa776d41 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:33.173332 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-fee4f9d0-0b86-4012-83fc-3ed3689a464f req-affe23c8-9230-4184-9157-0683aa776d41 service nova] Creating event network-vif-plugged:dc0d1f46-3f16-4656-8246-5fefd8f4774a for instance 240f19f3-04d8-4c10-a376-0f18377ee00a on hv-cinder-78836 May 26 15:10:33.179598 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-fee4f9d0-0b86-4012-83fc-3ed3689a464f req-affe23c8-9230-4184-9157-0683aa776d41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055159 May 26 15:10:33.181351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 101/196] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:33.294357 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f723b142-aacb-4c89-ba09-c5396b4ce814 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:33.294940 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f723b142-aacb-4c89-ba09-c5396b4ce814 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:33.306443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f723b142-aacb-4c89-ba09-c5396b4ce814 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:33.307599 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f723b142-aacb-4c89-ba09-c5396b4ce814 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:33.308648 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f723b142-aacb-4c89-ba09-c5396b4ce814 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:33.309300 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f723b142-aacb-4c89-ba09-c5396b4ce814 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:33.460389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f723b142-aacb-4c89-ba09-c5396b4ce814 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:33.473902 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f723b142-aacb-4c89-ba09-c5396b4ce814 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1272 microversion: 2.1 time: 0.183805 May 26 15:10:33.475685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 96/197] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:33 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:33.849742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-fb5acbd9-376c-40cd-ab16-94a1b7ee0aaf tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:33.850720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-fb5acbd9-376c-40cd-ab16-94a1b7ee0aaf tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:33.858037 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fb5acbd9-376c-40cd-ab16-94a1b7ee0aaf tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:33.858481 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fb5acbd9-376c-40cd-ab16-94a1b7ee0aaf tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:33.859268 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fb5acbd9-376c-40cd-ab16-94a1b7ee0aaf tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:33.859705 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fb5acbd9-376c-40cd-ab16-94a1b7ee0aaf tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.023256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-fb5acbd9-376c-40cd-ab16-94a1b7ee0aaf tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:34.032188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-fb5acbd9-376c-40cd-ab16-94a1b7ee0aaf tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1322 microversion: 2.1 time: 0.186655 May 26 15:10:34.032764 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 102/198] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:33 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:34.105314 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d11ded8b-8292-4d76-9350-80ba83801275 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:34.106221 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d11ded8b-8292-4d76-9350-80ba83801275 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:34.113647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d11ded8b-8292-4d76-9350-80ba83801275 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.114166 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d11ded8b-8292-4d76-9350-80ba83801275 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.115052 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d11ded8b-8292-4d76-9350-80ba83801275 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.115965 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d11ded8b-8292-4d76-9350-80ba83801275 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.145886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-d11ded8b-8292-4d76-9350-80ba83801275 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lazy-loading 'flavor' on Instance uuid 06cf01b4-e458-498b-990e-33b4171e1a14 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:34.497293 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a7eb8173-c48d-4246-aeda-e84dc9919c27 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:34.498289 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a7eb8173-c48d-4246-aeda-e84dc9919c27 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:34.510709 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a7eb8173-c48d-4246-aeda-e84dc9919c27 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.511169 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a7eb8173-c48d-4246-aeda-e84dc9919c27 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.511946 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a7eb8173-c48d-4246-aeda-e84dc9919c27 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.512388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a7eb8173-c48d-4246-aeda-e84dc9919c27 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.551414 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d11ded8b-8292-4d76-9350-80ba83801275 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/action" status: 202 len: 0 microversion: 2.20 time: 0.450737 May 26 15:10:34.552696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 97/199] 10.222.0.46 () {62 vars in 1318 bytes} [Thu May 26 15:10:34 2022] POST /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:10:34.567327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:34.568289 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:34.578718 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.579622 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.580671 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.583668 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.629499 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:34.796230 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a7eb8173-c48d-4246-aeda-e84dc9919c27 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:34.838942 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a7eb8173-c48d-4246-aeda-e84dc9919c27 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.348512 May 26 15:10:34.854468 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 103/200] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:34 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:34.884071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:34.913853 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:34.915374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:34.918787 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e6079a07-a033-4acd-9152-c325875deb2c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.360548 May 26 15:10:34.919755 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 98/201] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:34 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:34.937692 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-c9371205-8493-4477-af97-487bc27b75b1 req-77e283ef-28cb-4523-8b8f-932b934c7ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6492d5e-352b-4bc1-b655-8dad1cbf6911", "tag": "3e0d2ec0-c01d-44d0-8ead-95da4bad07d1"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:34.950965 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-c9371205-8493-4477-af97-487bc27b75b1 req-77e283ef-28cb-4523-8b8f-932b934c7ab0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:34.951614 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-c9371205-8493-4477-af97-487bc27b75b1 req-77e283ef-28cb-4523-8b8f-932b934c7ab0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:34.972418 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-c9371205-8493-4477-af97-487bc27b75b1 req-77e283ef-28cb-4523-8b8f-932b934c7ab0 service nova] Creating event network-changed:3e0d2ec0-c01d-44d0-8ead-95da4bad07d1 for instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 on hv-cinder-78836 May 26 15:10:34.981581 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-c9371205-8493-4477-af97-487bc27b75b1 req-77e283ef-28cb-4523-8b8f-932b934c7ab0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050220 May 26 15:10:34.982502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 104/202] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:35.049422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c17a9928-a964-43e3-94f5-eb5dccc6107d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:35.050073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c17a9928-a964-43e3-94f5-eb5dccc6107d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:35.056743 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c17a9928-a964-43e3-94f5-eb5dccc6107d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.057205 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c17a9928-a964-43e3-94f5-eb5dccc6107d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.058023 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c17a9928-a964-43e3-94f5-eb5dccc6107d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.058463 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c17a9928-a964-43e3-94f5-eb5dccc6107d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.200474 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c17a9928-a964-43e3-94f5-eb5dccc6107d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:35.208358 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c17a9928-a964-43e3-94f5-eb5dccc6107d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1516 microversion: 2.1 time: 0.162721 May 26 15:10:35.208957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 99/203] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:35 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:35.225902 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-93a098b8-7934-40f9-8910-47de0a987432 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:35.226931 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-93a098b8-7934-40f9-8910-47de0a987432 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:35.233737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-93a098b8-7934-40f9-8910-47de0a987432 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.234189 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-93a098b8-7934-40f9-8910-47de0a987432 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.234962 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-93a098b8-7934-40f9-8910-47de0a987432 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.235398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-93a098b8-7934-40f9-8910-47de0a987432 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.258089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-93a098b8-7934-40f9-8910-47de0a987432 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lazy-loading 'flavor' on Instance uuid 240f19f3-04d8-4c10-a376-0f18377ee00a {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:35.375567 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-93a098b8-7934-40f9-8910-47de0a987432 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a/action" status: 200 len: 32 microversion: 2.1 time: 0.153986 May 26 15:10:35.376239 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 105/204] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:10:35 2022] POST /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:10:35.387758 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1dae415f-c7ce-4995-8166-26923940dc41 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:35.388460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1dae415f-c7ce-4995-8166-26923940dc41 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:35.395214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1dae415f-c7ce-4995-8166-26923940dc41 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.395668 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1dae415f-c7ce-4995-8166-26923940dc41 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.396438 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1dae415f-c7ce-4995-8166-26923940dc41 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.396874 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1dae415f-c7ce-4995-8166-26923940dc41 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.540771 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1dae415f-c7ce-4995-8166-26923940dc41 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:35.548744 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1dae415f-c7ce-4995-8166-26923940dc41 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.167256 May 26 15:10:35.549501 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 100/205] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:35 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:35.866378 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d9308340-0b79-4b8c-8000-eade9c8e975d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:35.867896 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d9308340-0b79-4b8c-8000-eade9c8e975d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:35.877337 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d9308340-0b79-4b8c-8000-eade9c8e975d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.878026 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d9308340-0b79-4b8c-8000-eade9c8e975d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.879151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d9308340-0b79-4b8c-8000-eade9c8e975d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.879954 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d9308340-0b79-4b8c-8000-eade9c8e975d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.938779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:35.939397 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:35.950848 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.951504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:35.958421 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:35.959204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:36.219592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d9308340-0b79-4b8c-8000-eade9c8e975d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:36.234459 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d9308340-0b79-4b8c-8000-eade9c8e975d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.372298 May 26 15:10:36.246825 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 106/206] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:35 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:36.254473 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1934080723", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:36.320216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.network.neutron [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] validate_networks() for None {{(pid=117724) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:10:36.323668 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:36.333682 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:36.335248 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:36.336403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cd18dac3-efa5-494a-9848-75799049b2de tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.401570 May 26 15:10:36.336964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 101/207] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:35 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:36.565880 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f72e058d-1306-476a-a7c1-78f3ac840ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:36.566503 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f72e058d-1306-476a-a7c1-78f3ac840ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:36.572647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f72e058d-1306-476a-a7c1-78f3ac840ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:36.573098 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f72e058d-1306-476a-a7c1-78f3ac840ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:36.573907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f72e058d-1306-476a-a7c1-78f3ac840ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:36.574347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f72e058d-1306-476a-a7c1-78f3ac840ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:36.604962 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Flavor limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:10:36.605410 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Image limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:10:36.606192 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Flavor pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:10:36.606608 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Image pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:10:36.607027 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:10:36.616708 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:36.617162 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:36.618029 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:36.618469 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:36.637851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Getting quotas for project a272160dccba4f6b870efe8e25dae635. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:10:36.642302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Getting quotas for user 10a511609a9a4875845a1056be541667 and project a272160dccba4f6b870efe8e25dae635. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:10:36.653801 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Going to run 1 instances... {{(pid=117724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:10:36.656125 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:10:36.701808 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-eca23630-2c03-4ca4-b884-d565f320af12 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453343 May 26 15:10:36.707245 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 107/208] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:10:36.712346 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-fcd62a20-5127-4918-b178-fbf3f88db8e7 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:36.713037 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-fcd62a20-5127-4918-b178-fbf3f88db8e7 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:36.718975 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f72e058d-1306-476a-a7c1-78f3ac840ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:36.731672 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f72e058d-1306-476a-a7c1-78f3ac840ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.169561 May 26 15:10:36.732609 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 102/209] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:36 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:36.772387 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-fcd62a20-5127-4918-b178-fbf3f88db8e7 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:36.780537 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-fcd62a20-5127-4918-b178-fbf3f88db8e7 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1215 microversion: 2.1 time: 0.072051 May 26 15:10:36.781154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 108/210] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:36 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:37.254238 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-76d741ce-b4bb-437a-be2f-112060e15062 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:37.254842 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-76d741ce-b4bb-437a-be2f-112060e15062 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:37.261244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-76d741ce-b4bb-437a-be2f-112060e15062 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:37.261729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-76d741ce-b4bb-437a-be2f-112060e15062 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:37.262485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-76d741ce-b4bb-437a-be2f-112060e15062 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:37.262920 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-76d741ce-b4bb-437a-be2f-112060e15062 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:37.355391 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:37.355994 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:37.362195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:37.362639 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:37.363390 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:37.363820 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:37.394545 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-76d741ce-b4bb-437a-be2f-112060e15062 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:37.402431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-76d741ce-b4bb-437a-be2f-112060e15062 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.151899 May 26 15:10:37.403008 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 103/211] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:37 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:37.494253 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:37.502559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:37.504038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:37.505182 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ce748d25-e7d5-484f-add8-a1d5dd129ae4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.154134 May 26 15:10:37.505807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 109/212] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:37 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:37.749497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-52871b55-ba33-4fe1-9ba1-17f531589ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:37.750131 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-52871b55-ba33-4fe1-9ba1-17f531589ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:37.756110 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-52871b55-ba33-4fe1-9ba1-17f531589ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:37.756555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-52871b55-ba33-4fe1-9ba1-17f531589ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:37.757304 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-52871b55-ba33-4fe1-9ba1-17f531589ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:37.757770 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-52871b55-ba33-4fe1-9ba1-17f531589ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:37.797333 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-16424973-8fa6-4d08-a254-5e12cfd7bce8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:37.798124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-16424973-8fa6-4d08-a254-5e12cfd7bce8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:37.804184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-16424973-8fa6-4d08-a254-5e12cfd7bce8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:37.804631 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-16424973-8fa6-4d08-a254-5e12cfd7bce8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:37.805427 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-16424973-8fa6-4d08-a254-5e12cfd7bce8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:37.805862 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-16424973-8fa6-4d08-a254-5e12cfd7bce8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:37.881562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-16424973-8fa6-4d08-a254-5e12cfd7bce8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:37.889678 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-16424973-8fa6-4d08-a254-5e12cfd7bce8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1219 microversion: 2.1 time: 0.096198 May 26 15:10:37.890266 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 110/213] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:37 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:37.911619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-52871b55-ba33-4fe1-9ba1-17f531589ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:37.919501 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-52871b55-ba33-4fe1-9ba1-17f531589ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.174083 May 26 15:10:37.920252 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 104/214] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:37 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:38.419335 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8a5d132f-9877-452c-a516-c4be0875288a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:38.419949 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8a5d132f-9877-452c-a516-c4be0875288a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:38.426037 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8a5d132f-9877-452c-a516-c4be0875288a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:38.426489 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8a5d132f-9877-452c-a516-c4be0875288a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:38.427242 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8a5d132f-9877-452c-a516-c4be0875288a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:38.427674 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8a5d132f-9877-452c-a516-c4be0875288a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:38.445885 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:38.524044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:38.524659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:38.531135 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:38.531589 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:38.532361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:38.532787 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:38.560934 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8a5d132f-9877-452c-a516-c4be0875288a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:38.568443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8a5d132f-9877-452c-a516-c4be0875288a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.152931 May 26 15:10:38.569024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 111/215] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:38 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:38.671970 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:38.680082 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:38.682151 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:38.683297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1bfa2efe-8952-4e6d-81e3-3a1d6f92b4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.163121 May 26 15:10:38.683859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 105/216] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:38 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:38.907930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-146607ca-4751-457c-9eae-1c7c0f1139a2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:38.908456 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-146607ca-4751-457c-9eae-1c7c0f1139a2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:38.914470 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-146607ca-4751-457c-9eae-1c7c0f1139a2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:38.914908 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-146607ca-4751-457c-9eae-1c7c0f1139a2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:38.916157 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-146607ca-4751-457c-9eae-1c7c0f1139a2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:38.916852 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-146607ca-4751-457c-9eae-1c7c0f1139a2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:38.936685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-642706c7-eea0-46b7-82ac-bf4f00f439e8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:38.937374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-642706c7-eea0-46b7-82ac-bf4f00f439e8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:38.939298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:38.940160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=8 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:38.946084 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-642706c7-eea0-46b7-82ac-bf4f00f439e8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:38.946536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-642706c7-eea0-46b7-82ac-bf4f00f439e8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:38.947385 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-642706c7-eea0-46b7-82ac-bf4f00f439e8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:38.947832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-642706c7-eea0-46b7-82ac-bf4f00f439e8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:38.980318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-146607ca-4751-457c-9eae-1c7c0f1139a2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:38.987694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-146607ca-4751-457c-9eae-1c7c0f1139a2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1219 microversion: 2.1 time: 0.084261 May 26 15:10:38.988267 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 112/217] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:38 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:39.076329 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-642706c7-eea0-46b7-82ac-bf4f00f439e8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:39.083732 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-642706c7-eea0-46b7-82ac-bf4f00f439e8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.150969 May 26 15:10:39.084303 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 106/218] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:38 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:39.586157 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-dd98b531-21f9-4aaa-8e32-c28090c83dbe tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:39.586780 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-dd98b531-21f9-4aaa-8e32-c28090c83dbe tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:39.593404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-dd98b531-21f9-4aaa-8e32-c28090c83dbe tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:39.593884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-dd98b531-21f9-4aaa-8e32-c28090c83dbe tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:39.594644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-dd98b531-21f9-4aaa-8e32-c28090c83dbe tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:39.595081 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-dd98b531-21f9-4aaa-8e32-c28090c83dbe tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:39.702396 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:39.703008 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:39.709720 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:39.710180 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:39.710949 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:39.711387 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:39.726528 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-dd98b531-21f9-4aaa-8e32-c28090c83dbe tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:39.740761 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-dd98b531-21f9-4aaa-8e32-c28090c83dbe tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.151820 May 26 15:10:39.741393 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 113/219] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:39 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:39.854412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:39.862781 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:39.864418 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:39.865717 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4a6548d2-c114-467e-ab83-31a44a3998bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.167612 May 26 15:10:39.866281 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 107/220] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:39 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:40.004682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1de9a7ba-815a-4fd9-999d-c3588cd0c3b8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:40.005565 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1de9a7ba-815a-4fd9-999d-c3588cd0c3b8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:40.013846 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1de9a7ba-815a-4fd9-999d-c3588cd0c3b8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.014330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1de9a7ba-815a-4fd9-999d-c3588cd0c3b8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.015281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1de9a7ba-815a-4fd9-999d-c3588cd0c3b8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.015733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1de9a7ba-815a-4fd9-999d-c3588cd0c3b8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.093015 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1de9a7ba-815a-4fd9-999d-c3588cd0c3b8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:40.102599 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3557d647-f34d-4726-a9c5-b2f86e1cd822 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:40.105073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3557d647-f34d-4726-a9c5-b2f86e1cd822 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:40.120784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1de9a7ba-815a-4fd9-999d-c3588cd0c3b8 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1219 microversion: 2.1 time: 0.119949 May 26 15:10:40.123110 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3557d647-f34d-4726-a9c5-b2f86e1cd822 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.123632 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3557d647-f34d-4726-a9c5-b2f86e1cd822 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.124473 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3557d647-f34d-4726-a9c5-b2f86e1cd822 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.124878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3557d647-f34d-4726-a9c5-b2f86e1cd822 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.128885 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 114/221] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:39 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:40.348835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3557d647-f34d-4726-a9c5-b2f86e1cd822 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:40.361651 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3557d647-f34d-4726-a9c5-b2f86e1cd822 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.265271 May 26 15:10:40.362426 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 108/222] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:40 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:40.759820 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6747fcef-0fa2-48d6-91c5-6fd3f3982ea3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:40.760735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6747fcef-0fa2-48d6-91c5-6fd3f3982ea3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:40.773007 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6747fcef-0fa2-48d6-91c5-6fd3f3982ea3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.773796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6747fcef-0fa2-48d6-91c5-6fd3f3982ea3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.774693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6747fcef-0fa2-48d6-91c5-6fd3f3982ea3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.776304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6747fcef-0fa2-48d6-91c5-6fd3f3982ea3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.884327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:40.885762 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:40.892977 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.893592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:40.894438 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:40.895187 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:41.011562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6747fcef-0fa2-48d6-91c5-6fd3f3982ea3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:41.021530 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6747fcef-0fa2-48d6-91c5-6fd3f3982ea3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.266041 May 26 15:10:41.032302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 115/223] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:40 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:41.139303 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-55942d1d-8841-49a5-b29c-21ef1e889e74 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:41.140851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-55942d1d-8841-49a5-b29c-21ef1e889e74 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:41.156240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-55942d1d-8841-49a5-b29c-21ef1e889e74 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:41.158174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-55942d1d-8841-49a5-b29c-21ef1e889e74 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:41.160827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-55942d1d-8841-49a5-b29c-21ef1e889e74 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:41.162690 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-55942d1d-8841-49a5-b29c-21ef1e889e74 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:41.181234 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:41.192274 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:41.194069 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:41.195456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-82507306-8fee-489f-988e-cab427effd6b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.315079 May 26 15:10:41.196302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 109/224] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:40 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:41.299020 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-55942d1d-8841-49a5-b29c-21ef1e889e74 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:41.309385 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-55942d1d-8841-49a5-b29c-21ef1e889e74 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1273 microversion: 2.1 time: 0.174945 May 26 15:10:41.310596 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 116/225] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:41 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:41.381168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9703b068-f373-4a29-b02b-c2023fcb2979 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:41.381952 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9703b068-f373-4a29-b02b-c2023fcb2979 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:41.394824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9703b068-f373-4a29-b02b-c2023fcb2979 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:41.398574 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9703b068-f373-4a29-b02b-c2023fcb2979 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:41.400281 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9703b068-f373-4a29-b02b-c2023fcb2979 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:41.403116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9703b068-f373-4a29-b02b-c2023fcb2979 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:41.659038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9703b068-f373-4a29-b02b-c2023fcb2979 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:41.668484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9703b068-f373-4a29-b02b-c2023fcb2979 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.291889 May 26 15:10:41.669878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 110/226] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:41 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:42.038830 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a97a7d21-a851-486f-b8d3-5e8953cd0c2c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:42.039446 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a97a7d21-a851-486f-b8d3-5e8953cd0c2c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:42.046942 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a97a7d21-a851-486f-b8d3-5e8953cd0c2c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:42.047358 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a97a7d21-a851-486f-b8d3-5e8953cd0c2c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:42.048161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a97a7d21-a851-486f-b8d3-5e8953cd0c2c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:42.048653 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a97a7d21-a851-486f-b8d3-5e8953cd0c2c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:42.215664 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:42.216282 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:42.225316 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:42.226125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:42.227062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:42.227493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:42.279875 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a97a7d21-a851-486f-b8d3-5e8953cd0c2c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:42.289077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a97a7d21-a851-486f-b8d3-5e8953cd0c2c tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.254070 May 26 15:10:42.291178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 117/227] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:42 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:42.329425 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-75dd6c22-d07a-4719-aca4-0facd3b0cce1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:42.330152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-75dd6c22-d07a-4719-aca4-0facd3b0cce1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:42.345629 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75dd6c22-d07a-4719-aca4-0facd3b0cce1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:42.346080 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75dd6c22-d07a-4719-aca4-0facd3b0cce1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:42.346848 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75dd6c22-d07a-4719-aca4-0facd3b0cce1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:42.347278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75dd6c22-d07a-4719-aca4-0facd3b0cce1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:42.478436 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:42.486887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:42.488647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:42.490029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d509ec12-ecd0-437d-8e5f-a4e16f6d80cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.279288 May 26 15:10:42.490742 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 111/228] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:42 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:42.596471 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-75dd6c22-d07a-4719-aca4-0facd3b0cce1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:42.604090 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-75dd6c22-d07a-4719-aca4-0facd3b0cce1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.280360 May 26 15:10:42.609876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 118/229] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:42 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:42.686923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-daf0f87d-04ed-4f7a-8aec-5819514da6ba tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:42.687538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-daf0f87d-04ed-4f7a-8aec-5819514da6ba tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:42.693632 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-daf0f87d-04ed-4f7a-8aec-5819514da6ba tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:42.694093 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-daf0f87d-04ed-4f7a-8aec-5819514da6ba tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:42.694862 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-daf0f87d-04ed-4f7a-8aec-5819514da6ba tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:42.695372 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-daf0f87d-04ed-4f7a-8aec-5819514da6ba tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:42.943798 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-daf0f87d-04ed-4f7a-8aec-5819514da6ba tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:42.952130 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-daf0f87d-04ed-4f7a-8aec-5819514da6ba tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.268966 May 26 15:10:42.952812 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 112/230] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:42 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:43.224518 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-14a19e91-1c3b-48a8-bbb3-b8f8ecfcd42d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:43.225070 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-14a19e91-1c3b-48a8-bbb3-b8f8ecfcd42d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:43.232515 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-14a19e91-1c3b-48a8-bbb3-b8f8ecfcd42d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.234072 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-14a19e91-1c3b-48a8-bbb3-b8f8ecfcd42d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.235207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-14a19e91-1c3b-48a8-bbb3-b8f8ecfcd42d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.235865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-14a19e91-1c3b-48a8-bbb3-b8f8ecfcd42d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.264736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-14a19e91-1c3b-48a8-bbb3-b8f8ecfcd42d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/ips" status: 200 len: 145 microversion: 2.1 time: 0.044010 May 26 15:10:43.265635 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 119/231] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:10:43 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:43.308721 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4182234e-0f78-4aad-913c-7286b68ae452 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:43.309507 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4182234e-0f78-4aad-913c-7286b68ae452 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:43.317746 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4182234e-0f78-4aad-913c-7286b68ae452 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.318566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4182234e-0f78-4aad-913c-7286b68ae452 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.319747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4182234e-0f78-4aad-913c-7286b68ae452 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.320374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4182234e-0f78-4aad-913c-7286b68ae452 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.347526 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-c15fd615-a880-4430-aa77-b1f166377335 req-6b6881a3-364f-4a59-a930-6a5e7f1f19a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f2b242-3ace-4b3a-aebe-61c49fe76bb7", "tag": "736610d9-0031-4f0d-b417-d5c078104b49"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:43.366535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-c15fd615-a880-4430-aa77-b1f166377335 req-6b6881a3-364f-4a59-a930-6a5e7f1f19a6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.367738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-c15fd615-a880-4430-aa77-b1f166377335 req-6b6881a3-364f-4a59-a930-6a5e7f1f19a6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.386423 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-c15fd615-a880-4430-aa77-b1f166377335 req-6b6881a3-364f-4a59-a930-6a5e7f1f19a6 service nova] Creating event network-changed:736610d9-0031-4f0d-b417-d5c078104b49 for instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 on hv-cinder-78836 May 26 15:10:43.392227 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-c15fd615-a880-4430-aa77-b1f166377335 req-6b6881a3-364f-4a59-a930-6a5e7f1f19a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049410 May 26 15:10:43.393008 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 120/232] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:43.512681 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:43.513564 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:43.521747 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.522259 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.523113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.523555 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.539149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4182234e-0f78-4aad-913c-7286b68ae452 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:43.548005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4182234e-0f78-4aad-913c-7286b68ae452 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.244270 May 26 15:10:43.549419 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 113/233] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:43 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:43.621307 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e9519732-3064-4efb-b07f-54daf8da7966 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:43.621971 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e9519732-3064-4efb-b07f-54daf8da7966 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:43.632406 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e9519732-3064-4efb-b07f-54daf8da7966 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.638271 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e9519732-3064-4efb-b07f-54daf8da7966 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.639487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e9519732-3064-4efb-b07f-54daf8da7966 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.639993 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e9519732-3064-4efb-b07f-54daf8da7966 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.821034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:43.837049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:43.840302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:43.842639 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-36d3dd61-c3dc-45d0-b5b1-34a3d82f8dd2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.335861 May 26 15:10:43.853490 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 121/234] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:43 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:43.906051 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e9519732-3064-4efb-b07f-54daf8da7966 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:43.913894 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e9519732-3064-4efb-b07f-54daf8da7966 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.296822 May 26 15:10:43.915843 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 114/235] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:43 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:43.967986 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-529e6bcf-89ea-4a15-9006-3803e07cc88a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:43.968873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-529e6bcf-89ea-4a15-9006-3803e07cc88a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:43.975053 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-529e6bcf-89ea-4a15-9006-3803e07cc88a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.975498 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-529e6bcf-89ea-4a15-9006-3803e07cc88a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:43.976257 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-529e6bcf-89ea-4a15-9006-3803e07cc88a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:43.976685 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-529e6bcf-89ea-4a15-9006-3803e07cc88a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:44.115728 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-529e6bcf-89ea-4a15-9006-3803e07cc88a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:44.124335 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-529e6bcf-89ea-4a15-9006-3803e07cc88a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.160125 May 26 15:10:44.124920 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 122/236] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:43 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:44.566103 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-49811e2c-049d-420b-8271-f2334c71138e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:44.566715 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-49811e2c-049d-420b-8271-f2334c71138e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:44.574317 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49811e2c-049d-420b-8271-f2334c71138e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:44.575004 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49811e2c-049d-420b-8271-f2334c71138e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:44.575787 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49811e2c-049d-420b-8271-f2334c71138e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:44.576234 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49811e2c-049d-420b-8271-f2334c71138e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:44.579294 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:44.729664 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-49811e2c-049d-420b-8271-f2334c71138e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:44.737651 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-49811e2c-049d-420b-8271-f2334c71138e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.175257 May 26 15:10:44.738343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 115/237] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:44 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:44.864183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:44.864898 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:44.874415 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:44.875126 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:44.876730 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:44.877485 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:44.934445 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1f855794-ada9-458f-aec9-529bc51723a6 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:44.935059 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1f855794-ada9-458f-aec9-529bc51723a6 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:44.943216 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f855794-ada9-458f-aec9-529bc51723a6 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:44.943830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f855794-ada9-458f-aec9-529bc51723a6 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:44.944654 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f855794-ada9-458f-aec9-529bc51723a6 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:44.945090 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f855794-ada9-458f-aec9-529bc51723a6 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:45.055578 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:45.068407 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:45.071107 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:45.072963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d6547f45-60d5-4a6f-baa3-19c9da2d30c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.212899 May 26 15:10:45.073633 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 123/238] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:44 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:45.108057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1f855794-ada9-458f-aec9-529bc51723a6 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:45.116682 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1f855794-ada9-458f-aec9-529bc51723a6 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.187924 May 26 15:10:45.117392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 116/239] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:44 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:45.144733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f3ed1d31-14ee-4aa6-95ed-56de4e3c0830 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:45.145664 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f3ed1d31-14ee-4aa6-95ed-56de4e3c0830 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:45.153269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f3ed1d31-14ee-4aa6-95ed-56de4e3c0830 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:45.153746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f3ed1d31-14ee-4aa6-95ed-56de4e3c0830 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:45.154821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f3ed1d31-14ee-4aa6-95ed-56de4e3c0830 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:45.155431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f3ed1d31-14ee-4aa6-95ed-56de4e3c0830 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:45.207657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-89b9094d-99d6-4218-85fe-b33c9759a8f0 req-0ce45027-2c1c-4a0d-ae3c-caa07bff74f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6492d5e-352b-4bc1-b655-8dad1cbf6911", "name": "network-vif-plugged", "status": "completed", "tag": "3e0d2ec0-c01d-44d0-8ead-95da4bad07d1"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:45.217963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-89b9094d-99d6-4218-85fe-b33c9759a8f0 req-0ce45027-2c1c-4a0d-ae3c-caa07bff74f4 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:45.218973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-89b9094d-99d6-4218-85fe-b33c9759a8f0 req-0ce45027-2c1c-4a0d-ae3c-caa07bff74f4 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:45.233046 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-89b9094d-99d6-4218-85fe-b33c9759a8f0 req-0ce45027-2c1c-4a0d-ae3c-caa07bff74f4 service nova] Creating event network-vif-plugged:3e0d2ec0-c01d-44d0-8ead-95da4bad07d1 for instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 on hv-cinder-78836 May 26 15:10:45.238460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-89b9094d-99d6-4218-85fe-b33c9759a8f0 req-0ce45027-2c1c-4a0d-ae3c-caa07bff74f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034799 May 26 15:10:45.239170 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 117/240] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:10:45.304860 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f3ed1d31-14ee-4aa6-95ed-56de4e3c0830 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:45.313107 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f3ed1d31-14ee-4aa6-95ed-56de4e3c0830 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.174594 May 26 15:10:45.313718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 124/241] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:45 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:45.755952 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fa6e9d7c-8406-4e90-8c62-d01d9ebf3ec7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:45.756832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fa6e9d7c-8406-4e90-8c62-d01d9ebf3ec7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:45.762420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:45.764918 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa6e9d7c-8406-4e90-8c62-d01d9ebf3ec7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:45.765603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa6e9d7c-8406-4e90-8c62-d01d9ebf3ec7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:45.766503 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa6e9d7c-8406-4e90-8c62-d01d9ebf3ec7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:45.767684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fa6e9d7c-8406-4e90-8c62-d01d9ebf3ec7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:45.998984 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fa6e9d7c-8406-4e90-8c62-d01d9ebf3ec7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:46.006688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fa6e9d7c-8406-4e90-8c62-d01d9ebf3ec7 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.255418 May 26 15:10:46.007277 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 118/242] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:45 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:46.091500 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:46.092312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:46.099093 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:46.099628 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:46.100393 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:46.100824 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:46.134719 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-82ec9995-ba5d-4bc0-a870-cfe63de65e7b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:46.135648 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-82ec9995-ba5d-4bc0-a870-cfe63de65e7b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:46.141868 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82ec9995-ba5d-4bc0-a870-cfe63de65e7b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:46.142316 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82ec9995-ba5d-4bc0-a870-cfe63de65e7b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:46.143087 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82ec9995-ba5d-4bc0-a870-cfe63de65e7b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:46.143547 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82ec9995-ba5d-4bc0-a870-cfe63de65e7b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:46.305594 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:46.314954 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:46.316479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:46.317704 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5ad18266-b95e-43d5-8b2d-c454ace58deb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.230833 May 26 15:10:46.318357 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 125/243] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:46 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:10:46.332779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-82ec9995-ba5d-4bc0-a870-cfe63de65e7b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:46.334967 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b72c0698-138d-4dee-8478-17ef695deabd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:46.335727 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b72c0698-138d-4dee-8478-17ef695deabd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:46.340774 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-82ec9995-ba5d-4bc0-a870-cfe63de65e7b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.210615 May 26 15:10:46.341402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 119/244] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:46 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:46.341960 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b72c0698-138d-4dee-8478-17ef695deabd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:46.342412 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b72c0698-138d-4dee-8478-17ef695deabd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:46.343181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b72c0698-138d-4dee-8478-17ef695deabd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:46.343617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b72c0698-138d-4dee-8478-17ef695deabd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:46.502393 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b72c0698-138d-4dee-8478-17ef695deabd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:46.510283 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b72c0698-138d-4dee-8478-17ef695deabd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.179070 May 26 15:10:46.510862 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 126/245] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:46 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:47.024194 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8afd1fd1-c8eb-4722-a77a-77c0c56c56df tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:47.025599 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8afd1fd1-c8eb-4722-a77a-77c0c56c56df tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:47.032599 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8afd1fd1-c8eb-4722-a77a-77c0c56c56df tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.033230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8afd1fd1-c8eb-4722-a77a-77c0c56c56df tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.034048 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8afd1fd1-c8eb-4722-a77a-77c0c56c56df tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.034488 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8afd1fd1-c8eb-4722-a77a-77c0c56c56df tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.267753 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8afd1fd1-c8eb-4722-a77a-77c0c56c56df tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:47.275641 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8afd1fd1-c8eb-4722-a77a-77c0c56c56df tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1314 microversion: 2.1 time: 0.255259 May 26 15:10:47.276241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 120/246] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:47 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:47.346847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:47.354981 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:47.363144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f53e23d4-7590-4ed8-baa8-2c0f19ecd465 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:47.366847 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f53e23d4-7590-4ed8-baa8-2c0f19ecd465 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:47.370046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:47.372066 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=8 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:47.377172 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.379500 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.380830 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.383609 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.399026 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f53e23d4-7590-4ed8-baa8-2c0f19ecd465 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.399331 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f53e23d4-7590-4ed8-baa8-2c0f19ecd465 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.401215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f53e23d4-7590-4ed8-baa8-2c0f19ecd465 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.402014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f53e23d4-7590-4ed8-baa8-2c0f19ecd465 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.669307 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f53e23d4-7590-4ed8-baa8-2c0f19ecd465 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:47.673592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:47.681364 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f53e23d4-7590-4ed8-baa8-2c0f19ecd465 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.325560 May 26 15:10:47.692891 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:47.692891 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:47.692891 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b28ffc99-3eef-4d54-a05b-dad237ca0c57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.344137 May 26 15:10:47.693248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 127/247] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:47 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:10:47.693248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-2c36f21d-afda-4c65-babd-3ca86ae02ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:47.693248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-2c36f21d-afda-4c65-babd-3ca86ae02ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:47.694534 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 121/248] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:47 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:47.701118 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2c36f21d-afda-4c65-babd-3ca86ae02ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.701593 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2c36f21d-afda-4c65-babd-3ca86ae02ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.702367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2c36f21d-afda-4c65-babd-3ca86ae02ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:47.702844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2c36f21d-afda-4c65-babd-3ca86ae02ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:47.909537 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-2c36f21d-afda-4c65-babd-3ca86ae02ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:47.917656 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-2c36f21d-afda-4c65-babd-3ca86ae02ecd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.228879 May 26 15:10:47.918447 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 128/249] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:47 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:48.293644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-025242d9-cbde-4fd5-a8f4-38a84e243343 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:48.294253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-025242d9-cbde-4fd5-a8f4-38a84e243343 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:48.302173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-025242d9-cbde-4fd5-a8f4-38a84e243343 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.302621 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-025242d9-cbde-4fd5-a8f4-38a84e243343 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.303392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-025242d9-cbde-4fd5-a8f4-38a84e243343 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.303827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-025242d9-cbde-4fd5-a8f4-38a84e243343 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.441486 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-025242d9-cbde-4fd5-a8f4-38a84e243343 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:48.451532 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-025242d9-cbde-4fd5-a8f4-38a84e243343 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1497 microversion: 2.1 time: 0.162117 May 26 15:10:48.452361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 122/250] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:48 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:48.702212 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-18dcb057-6075-4277-9af1-f4f0d4ba0e67 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:48.702949 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-18dcb057-6075-4277-9af1-f4f0d4ba0e67 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:48.706540 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:48.707341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:48.709706 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-18dcb057-6075-4277-9af1-f4f0d4ba0e67 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.710168 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-18dcb057-6075-4277-9af1-f4f0d4ba0e67 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.710973 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-18dcb057-6075-4277-9af1-f4f0d4ba0e67 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.711602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-18dcb057-6075-4277-9af1-f4f0d4ba0e67 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.715906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.717227 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:48.717876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.719000 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.720120 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.949303 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-18dcb057-6075-4277-9af1-f4f0d4ba0e67 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:48.958426 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-18dcb057-6075-4277-9af1-f4f0d4ba0e67 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.260830 May 26 15:10:48.959020 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 129/251] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:48 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:48.969380 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-789b9813-e868-4f0a-900f-015bf82c3858 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8caa24e3-87ca-4343-bb1b-27cb0a4b2f60"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:48.970982 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-789b9813-e868-4f0a-900f-015bf82c3858 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:48.978238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-789b9813-e868-4f0a-900f-015bf82c3858 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.978980 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-789b9813-e868-4f0a-900f-015bf82c3858 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.979957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-789b9813-e868-4f0a-900f-015bf82c3858 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:48.980559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-789b9813-e868-4f0a-900f-015bf82c3858 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:48.986402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:48.996109 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:48.998129 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:48.999792 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-74f93d51-9976-48cb-b565-ca3bb74374ac tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.297661 May 26 15:10:49.004151 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 123/252] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:48 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:49.006809 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a413aed0-5fe1-4940-aba4-9da7d6600237 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:49.007434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a413aed0-5fe1-4940-aba4-9da7d6600237 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:49.020243 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a413aed0-5fe1-4940-aba4-9da7d6600237 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.020970 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a413aed0-5fe1-4940-aba4-9da7d6600237 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.021814 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a413aed0-5fe1-4940-aba4-9da7d6600237 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.022259 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a413aed0-5fe1-4940-aba4-9da7d6600237 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.176248 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a413aed0-5fe1-4940-aba4-9da7d6600237 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:49.189867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a413aed0-5fe1-4940-aba4-9da7d6600237 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.187605 May 26 15:10:49.190728 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 124/253] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:49 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:49.235647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6a3984cc-8902-4f20-b3e4-004b88c6af3e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:49.236158 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6a3984cc-8902-4f20-b3e4-004b88c6af3e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:49.242291 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a3984cc-8902-4f20-b3e4-004b88c6af3e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.242747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a3984cc-8902-4f20-b3e4-004b88c6af3e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.244101 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a3984cc-8902-4f20-b3e4-004b88c6af3e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.244544 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a3984cc-8902-4f20-b3e4-004b88c6af3e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.273814 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6a3984cc-8902-4f20-b3e4-004b88c6af3e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:10:49.383636 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6a3984cc-8902-4f20-b3e4-004b88c6af3e tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 204 len: 0 microversion: 2.1 time: 0.151531 May 26 15:10:49.385036 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 125/254] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:10:49 2022] DELETE /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:10:49.394022 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-5ca0a9a1-25bb-4910-a838-46457440929c req-e9f1fa6f-48e5-4469-a7a4-a3bed3ce8817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f2b242-3ace-4b3a-aebe-61c49fe76bb7", "name": "network-vif-plugged", "status": "completed", "tag": "736610d9-0031-4f0d-b417-d5c078104b49"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:49.403369 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5ca0a9a1-25bb-4910-a838-46457440929c req-e9f1fa6f-48e5-4469-a7a4-a3bed3ce8817 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.403820 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5ca0a9a1-25bb-4910-a838-46457440929c req-e9f1fa6f-48e5-4469-a7a4-a3bed3ce8817 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.416134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-5ca0a9a1-25bb-4910-a838-46457440929c req-e9f1fa6f-48e5-4469-a7a4-a3bed3ce8817 service nova] Creating event network-vif-plugged:736610d9-0031-4f0d-b417-d5c078104b49 for instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 on hv-cinder-78836 May 26 15:10:49.421291 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-5ca0a9a1-25bb-4910-a838-46457440929c req-e9f1fa6f-48e5-4469-a7a4-a3bed3ce8817 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031406 May 26 15:10:49.422127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 126/255] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:49.427299 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-47789e8c-4978-49c7-af61-ea4999884239 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:49.428019 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-47789e8c-4978-49c7-af61-ea4999884239 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:49.434779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47789e8c-4978-49c7-af61-ea4999884239 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.435241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47789e8c-4978-49c7-af61-ea4999884239 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.436041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47789e8c-4978-49c7-af61-ea4999884239 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.436504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47789e8c-4978-49c7-af61-ea4999884239 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.585110 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-47789e8c-4978-49c7-af61-ea4999884239 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:49.587858 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-789b9813-e868-4f0a-900f-015bf82c3858 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626822 May 26 15:10:49.588497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 130/256] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:10:48 2022] POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/os-volume_attachments => generated 194 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:49.593875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-47789e8c-4978-49c7-af61-ea4999884239 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1503 microversion: 2.1 time: 0.170712 May 26 15:10:49.594450 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 127/257] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:49 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:49.976061 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bf770c8c-25f4-41fd-8731-ad546813cce9 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:49.976763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bf770c8c-25f4-41fd-8731-ad546813cce9 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:49.983295 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bf770c8c-25f4-41fd-8731-ad546813cce9 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.983717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bf770c8c-25f4-41fd-8731-ad546813cce9 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:49.984538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bf770c8c-25f4-41fd-8731-ad546813cce9 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:49.984972 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bf770c8c-25f4-41fd-8731-ad546813cce9 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.020138 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:50.020856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:50.027666 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:50.028108 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.028955 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:50.029383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.378315 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bf770c8c-25f4-41fd-8731-ad546813cce9 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:50.386464 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bf770c8c-25f4-41fd-8731-ad546813cce9 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.415287 May 26 15:10:50.387349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 131/258] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:49 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:50.392115 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-36627579-feb7-42f7-8937-4555e2f20396 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:50.393004 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-36627579-feb7-42f7-8937-4555e2f20396 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:50.395980 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:50.400852 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36627579-feb7-42f7-8937-4555e2f20396 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:50.401372 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36627579-feb7-42f7-8937-4555e2f20396 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.402179 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36627579-feb7-42f7-8937-4555e2f20396 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:50.402637 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36627579-feb7-42f7-8937-4555e2f20396 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.411720 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:50.422017 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:50.424950 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:50.426578 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1b78fdd2-abbf-43bf-8be1-8ed70276ccaf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.410630 May 26 15:10:50.438217 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 128/259] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:50 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:10:50.567159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-36627579-feb7-42f7-8937-4555e2f20396 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:50.575823 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-36627579-feb7-42f7-8937-4555e2f20396 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.187532 May 26 15:10:50.576566 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 132/260] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:50 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:50.611741 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fefb5c51-1915-4fb6-a04d-e4e7e93a82e5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:50.612538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fefb5c51-1915-4fb6-a04d-e4e7e93a82e5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:50.620005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fefb5c51-1915-4fb6-a04d-e4e7e93a82e5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:50.620210 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fefb5c51-1915-4fb6-a04d-e4e7e93a82e5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.621326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fefb5c51-1915-4fb6-a04d-e4e7e93a82e5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:50.621795 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fefb5c51-1915-4fb6-a04d-e4e7e93a82e5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:50.766513 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fefb5c51-1915-4fb6-a04d-e4e7e93a82e5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:50.775609 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fefb5c51-1915-4fb6-a04d-e4e7e93a82e5 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1503 microversion: 2.1 time: 0.167620 May 26 15:10:50.776432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 129/261] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:50 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:51.404573 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8627ecdd-c333-47cf-a321-24014965b757 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:51.405206 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8627ecdd-c333-47cf-a321-24014965b757 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:51.411264 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8627ecdd-c333-47cf-a321-24014965b757 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.411713 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8627ecdd-c333-47cf-a321-24014965b757 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.412480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8627ecdd-c333-47cf-a321-24014965b757 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.412917 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8627ecdd-c333-47cf-a321-24014965b757 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.449196 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:51.449873 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:51.456561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.457017 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.457829 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.458276 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.609824 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8627ecdd-c333-47cf-a321-24014965b757 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:51.628341 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8627ecdd-c333-47cf-a321-24014965b757 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.227119 May 26 15:10:51.629828 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 133/262] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:51 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:51.638716 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-cb60a219-9197-4a8c-8831-ea90380eccad tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:51.639858 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cb60a219-9197-4a8c-8831-ea90380eccad tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:51.650912 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cb60a219-9197-4a8c-8831-ea90380eccad tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.651784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cb60a219-9197-4a8c-8831-ea90380eccad tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.652891 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cb60a219-9197-4a8c-8831-ea90380eccad tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.653329 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:51.653511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cb60a219-9197-4a8c-8831-ea90380eccad tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.662146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:51.663772 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:51.665005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c06dd5d8-6305-4fc1-b589-fc4bd2e334e4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.220427 May 26 15:10:51.665765 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 130/263] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:51 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:51.785534 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-cb60a219-9197-4a8c-8831-ea90380eccad tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:51.792628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-69cf4a9c-088c-4e6d-9c0b-b4185c0fccf3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:51.793146 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-cb60a219-9197-4a8c-8831-ea90380eccad tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.162183 May 26 15:10:51.793262 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-69cf4a9c-088c-4e6d-9c0b-b4185c0fccf3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:51.793748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 134/264] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:51 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:51.799389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-69cf4a9c-088c-4e6d-9c0b-b4185c0fccf3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.799916 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-69cf4a9c-088c-4e6d-9c0b-b4185c0fccf3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.800732 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-69cf4a9c-088c-4e6d-9c0b-b4185c0fccf3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:51.801109 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-69cf4a9c-088c-4e6d-9c0b-b4185c0fccf3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:51.817355 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:51.940023 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-69cf4a9c-088c-4e6d-9c0b-b4185c0fccf3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:51.948264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-69cf4a9c-088c-4e6d-9c0b-b4185c0fccf3 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1503 microversion: 2.1 time: 0.159459 May 26 15:10:51.948833 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 131/265] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:51 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:52.646407 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a4588105-d3b7-4d8b-9fc6-f9b22e980245 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:52.647101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a4588105-d3b7-4d8b-9fc6-f9b22e980245 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:52.654089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4588105-d3b7-4d8b-9fc6-f9b22e980245 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.654826 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4588105-d3b7-4d8b-9fc6-f9b22e980245 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.655597 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4588105-d3b7-4d8b-9fc6-f9b22e980245 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.656033 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4588105-d3b7-4d8b-9fc6-f9b22e980245 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.682868 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:52.683844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:52.690670 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.691133 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.691900 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.692338 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.854436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a4588105-d3b7-4d8b-9fc6-f9b22e980245 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:52.862312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a4588105-d3b7-4d8b-9fc6-f9b22e980245 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.220066 May 26 15:10:52.874385 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 135/266] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:52 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:52.879801 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-36c2d944-f7b7-42f4-ac68-c81107bbbe05 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:52.880437 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-36c2d944-f7b7-42f4-ac68-c81107bbbe05 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:52.886760 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36c2d944-f7b7-42f4-ac68-c81107bbbe05 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.887205 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36c2d944-f7b7-42f4-ac68-c81107bbbe05 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.887963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36c2d944-f7b7-42f4-ac68-c81107bbbe05 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.888388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36c2d944-f7b7-42f4-ac68-c81107bbbe05 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.888929 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:52.896979 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:52.898568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:52.900270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e50bbbc4-1875-4ae8-b1c2-e8d407319360 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1744 microversion: 2.20 time: 0.220875 May 26 15:10:52.900836 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 132/267] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:52 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:52.968723 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6a202d96-3534-4b81-86a0-59d7b8aaabf1 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:52.969556 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6a202d96-3534-4b81-86a0-59d7b8aaabf1 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:52.975926 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a202d96-3534-4b81-86a0-59d7b8aaabf1 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.976365 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a202d96-3534-4b81-86a0-59d7b8aaabf1 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:52.977125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a202d96-3534-4b81-86a0-59d7b8aaabf1 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:52.977643 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6a202d96-3534-4b81-86a0-59d7b8aaabf1 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:53.033533 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-36c2d944-f7b7-42f4-ac68-c81107bbbe05 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:53.041940 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-36c2d944-f7b7-42f4-ac68-c81107bbbe05 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.166154 May 26 15:10:53.042527 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 136/268] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:52 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:53.118542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6a202d96-3534-4b81-86a0-59d7b8aaabf1 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:53.126447 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6a202d96-3534-4b81-86a0-59d7b8aaabf1 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1503 microversion: 2.1 time: 0.162585 May 26 15:10:53.127014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 133/269] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:52 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:53.753516 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-2899e734-1bd8-48da-8f47-3dccf067931d req-6b4d5353-250a-47b1-bdd7-e0bb104417ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6492d5e-352b-4bc1-b655-8dad1cbf6911", "name": "network-vif-deleted", "tag": "3e0d2ec0-c01d-44d0-8ead-95da4bad07d1"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:53.763638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-2899e734-1bd8-48da-8f47-3dccf067931d req-6b4d5353-250a-47b1-bdd7-e0bb104417ff service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:53.764101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-2899e734-1bd8-48da-8f47-3dccf067931d req-6b4d5353-250a-47b1-bdd7-e0bb104417ff service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:53.775367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-2899e734-1bd8-48da-8f47-3dccf067931d req-6b4d5353-250a-47b1-bdd7-e0bb104417ff service nova] Creating event network-vif-deleted:3e0d2ec0-c01d-44d0-8ead-95da4bad07d1 for instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 on hv-cinder-78836 May 26 15:10:53.779974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-2899e734-1bd8-48da-8f47-3dccf067931d req-6b4d5353-250a-47b1-bdd7-e0bb104417ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030203 May 26 15:10:53.780550 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 137/270] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:53.885937 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3f69bd4c-c764-4824-a7c4-f6b54b0bd95e tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:53.886718 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3f69bd4c-c764-4824-a7c4-f6b54b0bd95e tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:53.893253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f69bd4c-c764-4824-a7c4-f6b54b0bd95e tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:53.893743 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f69bd4c-c764-4824-a7c4-f6b54b0bd95e tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:53.894514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f69bd4c-c764-4824-a7c4-f6b54b0bd95e tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:53.894975 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f69bd4c-c764-4824-a7c4-f6b54b0bd95e tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:53.920256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:53.921149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:53.927505 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:53.927956 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:53.928725 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:53.929165 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:54.109420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3f69bd4c-c764-4824-a7c4-f6b54b0bd95e tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:54.113605 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:54.117328 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3f69bd4c-c764-4824-a7c4-f6b54b0bd95e tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1315 microversion: 2.1 time: 0.235728 May 26 15:10:54.117956 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 134/271] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:53 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:54.122761 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:54.123240 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-97d319fd-b1fb-4d87-89bd-45d9a0e67ef3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:54.123845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-97d319fd-b1fb-4d87-89bd-45d9a0e67ef3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:54.124273 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:54.125434 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1992c7fa-409b-4071-8dac-776e69f99cfa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1744 microversion: 2.20 time: 0.209914 May 26 15:10:54.126182 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 138/272] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:53 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:54.129804 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-97d319fd-b1fb-4d87-89bd-45d9a0e67ef3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:54.130257 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-97d319fd-b1fb-4d87-89bd-45d9a0e67ef3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:54.131016 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-97d319fd-b1fb-4d87-89bd-45d9a0e67ef3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:54.131452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-97d319fd-b1fb-4d87-89bd-45d9a0e67ef3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:54.144825 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9c16b60e-b0b9-4c04-997b-df67f887d02d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:54.148060 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9c16b60e-b0b9-4c04-997b-df67f887d02d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:54.153665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9c16b60e-b0b9-4c04-997b-df67f887d02d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:54.154116 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9c16b60e-b0b9-4c04-997b-df67f887d02d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:54.154882 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9c16b60e-b0b9-4c04-997b-df67f887d02d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:54.155312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9c16b60e-b0b9-4c04-997b-df67f887d02d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:54.243943 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9c16b60e-b0b9-4c04-997b-df67f887d02d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:54.252160 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9c16b60e-b0b9-4c04-997b-df67f887d02d tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1461 microversion: 2.1 time: 0.111892 May 26 15:10:54.252862 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 139/273] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:54 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1461 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:54.301936 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-97d319fd-b1fb-4d87-89bd-45d9a0e67ef3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:54.310143 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-97d319fd-b1fb-4d87-89bd-45d9a0e67ef3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.190396 May 26 15:10:54.310708 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 135/274] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:54 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:55.135737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9467630f-ec6d-4d2f-a78f-7d13831feaaf tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:55.136440 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9467630f-ec6d-4d2f-a78f-7d13831feaaf tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:55.143744 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9467630f-ec6d-4d2f-a78f-7d13831feaaf tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.144186 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9467630f-ec6d-4d2f-a78f-7d13831feaaf tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.144817 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:55.145259 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9467630f-ec6d-4d2f-a78f-7d13831feaaf tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.145350 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9467630f-ec6d-4d2f-a78f-7d13831feaaf tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.145748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:55.153623 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.154768 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.155830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.156380 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.367452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:55.377980 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9467630f-ec6d-4d2f-a78f-7d13831feaaf tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:55.379343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:55.380963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:55.387989 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9467630f-ec6d-4d2f-a78f-7d13831feaaf tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1465 microversion: 2.1 time: 0.256872 May 26 15:10:55.388806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 140/275] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:55 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:55.389583 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-562fb3b3-38dd-4c01-a168-112b593175d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1744 microversion: 2.20 time: 0.248810 May 26 15:10:55.394278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:55.395207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:55.401306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 136/276] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:55 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1744 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:55.404274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.404274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.404274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.406564 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.417415 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-abf3f838-2526-45fd-8456-4522f112900d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:55.419431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-abf3f838-2526-45fd-8456-4522f112900d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:55.426666 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-abf3f838-2526-45fd-8456-4522f112900d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.427106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-abf3f838-2526-45fd-8456-4522f112900d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.427869 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-abf3f838-2526-45fd-8456-4522f112900d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.428480 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-abf3f838-2526-45fd-8456-4522f112900d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.446574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.447155 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.447853 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lazy-loading 'fault' on Instance uuid d6492d5e-352b-4bc1-b655-8dad1cbf6911 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:55.506299 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:55.514126 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d3fad29c-6551-4fad-8fa2-bdc26cbd3d70 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1304 microversion: 2.1 time: 0.124119 May 26 15:10:55.514909 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 141/277] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:55 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:55.519124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a0398cdf-a3d2-4a6a-9dfe-4d72543e20f2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:55.519621 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a0398cdf-a3d2-4a6a-9dfe-4d72543e20f2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:55.526477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a0398cdf-a3d2-4a6a-9dfe-4d72543e20f2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.526928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a0398cdf-a3d2-4a6a-9dfe-4d72543e20f2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.527786 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a0398cdf-a3d2-4a6a-9dfe-4d72543e20f2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.528227 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a0398cdf-a3d2-4a6a-9dfe-4d72543e20f2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.554686 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a0398cdf-a3d2-4a6a-9dfe-4d72543e20f2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:10:55.601309 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-abf3f838-2526-45fd-8456-4522f112900d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:55.610078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-abf3f838-2526-45fd-8456-4522f112900d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.207589 May 26 15:10:55.611273 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 137/278] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:55 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:55.652105 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a0398cdf-a3d2-4a6a-9dfe-4d72543e20f2 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "DELETE /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 204 len: 0 microversion: 2.1 time: 0.136145 May 26 15:10:55.652692 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 142/279] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:10:55 2022] DELETE /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:10:55.660817 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4aee23f3-bf04-4c71-8dc6-b1404370f75b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:55.661416 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4aee23f3-bf04-4c71-8dc6-b1404370f75b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:55.668326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4aee23f3-bf04-4c71-8dc6-b1404370f75b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.668789 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4aee23f3-bf04-4c71-8dc6-b1404370f75b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.669592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4aee23f3-bf04-4c71-8dc6-b1404370f75b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:55.670029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4aee23f3-bf04-4c71-8dc6-b1404370f75b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:55.803799 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4aee23f3-bf04-4c71-8dc6-b1404370f75b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:55.811540 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4aee23f3-bf04-4c71-8dc6-b1404370f75b tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1471 microversion: 2.1 time: 0.154541 May 26 15:10:55.812253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 138/280] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:55 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:56.408524 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:56.409259 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:56.415850 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.416304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.417069 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.417539 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.421649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:10:56.531478 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:56.532233 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:56.538964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.539492 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.540362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.540877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.557363 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:56.565628 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:56.567144 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:56.568373 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7e324368-6209-4ed5-b5d8-adc2230df78e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1744 microversion: 2.20 time: 0.164207 May 26 15:10:56.569021 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 143/281] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:56 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:10:56.578320 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.578769 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.579227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lazy-loading 'fault' on Instance uuid d6492d5e-352b-4bc1-b655-8dad1cbf6911 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:56.625107 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:56.627998 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8eaa08a1-f589-4ecd-b8fd-6cb9da8a73e9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:56.628626 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8eaa08a1-f589-4ecd-b8fd-6cb9da8a73e9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:56.632873 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ca6e9932-58f5-4b4e-a38f-1efadc04d19a tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1304 microversion: 2.1 time: 0.105362 May 26 15:10:56.633601 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 139/282] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:56 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:56.635224 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8eaa08a1-f589-4ecd-b8fd-6cb9da8a73e9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.635679 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8eaa08a1-f589-4ecd-b8fd-6cb9da8a73e9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.636453 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8eaa08a1-f589-4ecd-b8fd-6cb9da8a73e9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.636897 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8eaa08a1-f589-4ecd-b8fd-6cb9da8a73e9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.769410 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8eaa08a1-f589-4ecd-b8fd-6cb9da8a73e9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:56.776955 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8eaa08a1-f589-4ecd-b8fd-6cb9da8a73e9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.153028 May 26 15:10:56.777542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 144/283] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:56 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:56.829318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7c7e02bb-9e62-4260-8290-27bf19367fa1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:56.830107 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7c7e02bb-9e62-4260-8290-27bf19367fa1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:56.836299 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7c7e02bb-9e62-4260-8290-27bf19367fa1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.836752 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7c7e02bb-9e62-4260-8290-27bf19367fa1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.837556 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7c7e02bb-9e62-4260-8290-27bf19367fa1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:56.837994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7c7e02bb-9e62-4260-8290-27bf19367fa1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:56.978774 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7c7e02bb-9e62-4260-8290-27bf19367fa1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:56.986276 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7c7e02bb-9e62-4260-8290-27bf19367fa1 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1471 microversion: 2.1 time: 0.161000 May 26 15:10:56.986878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 140/284] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:56 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:57.301179 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-7426bacb-de47-4482-954b-f9d831ceeea8 req-7f1fee67-33ca-496b-96a1-ed99399f3105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06cf01b4-e458-498b-990e-33b4171e1a14", "name": "network-vif-plugged", "status": "completed", "tag": "2e5306c2-86c5-4899-9abd-3ff6e390eb95"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:57.310864 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-7426bacb-de47-4482-954b-f9d831ceeea8 req-7f1fee67-33ca-496b-96a1-ed99399f3105 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.311358 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-7426bacb-de47-4482-954b-f9d831ceeea8 req-7f1fee67-33ca-496b-96a1-ed99399f3105 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.325928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-7426bacb-de47-4482-954b-f9d831ceeea8 req-7f1fee67-33ca-496b-96a1-ed99399f3105 service nova] Creating event network-vif-plugged:2e5306c2-86c5-4899-9abd-3ff6e390eb95 for instance 06cf01b4-e458-498b-990e-33b4171e1a14 on hv-cinder-78836 May 26 15:10:57.331108 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-7426bacb-de47-4482-954b-f9d831ceeea8 req-7f1fee67-33ca-496b-96a1-ed99399f3105 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033976 May 26 15:10:57.331897 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 145/285] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:57.588597 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:57.589229 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:57.595758 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.596202 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.596949 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.597378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.651404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:57.652016 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:57.659020 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.659461 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.660991 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.660991 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.693932 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.694384 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.694840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lazy-loading 'fault' on Instance uuid d6492d5e-352b-4bc1-b655-8dad1cbf6911 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:57.744294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c54e915f4014d58ba28d6e6d5dd6ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '664448e66c54440f909ae6727ccc3deb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:57.752461 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e6eae20c-6d78-45fa-b06b-84f543676fac tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 200 len: 1304 microversion: 2.1 time: 0.106290 May 26 15:10:57.753058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 146/286] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:57 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:57.758064 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:57.766956 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:57.768456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:57.769634 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8cda9767-b0b2-43e0-bb61-dc42cbdf643a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1744 microversion: 2.20 time: 0.185742 May 26 15:10:57.770191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 141/287] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:57 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:10:57.793778 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f8d5db9d-ca91-4ba7-af84-1c2994212c0c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:57.794499 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f8d5db9d-ca91-4ba7-af84-1c2994212c0c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:57.800690 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f8d5db9d-ca91-4ba7-af84-1c2994212c0c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.801221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f8d5db9d-ca91-4ba7-af84-1c2994212c0c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.802068 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f8d5db9d-ca91-4ba7-af84-1c2994212c0c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:57.802670 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f8d5db9d-ca91-4ba7-af84-1c2994212c0c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:57.939559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f8d5db9d-ca91-4ba7-af84-1c2994212c0c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:57.947787 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f8d5db9d-ca91-4ba7-af84-1c2994212c0c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.157925 May 26 15:10:57.948349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 147/288] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:57 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:58.004500 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-58d0116c-3936-4d88-8565-1d5cf06c610f tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:58.005402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-58d0116c-3936-4d88-8565-1d5cf06c610f tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:58.009752 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-19d42569-7a04-49ec-8b50-393fc2c01220 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:58.010241 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-19d42569-7a04-49ec-8b50-393fc2c01220 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:58.013124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58d0116c-3936-4d88-8565-1d5cf06c610f tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.013254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58d0116c-3936-4d88-8565-1d5cf06c610f tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.014237 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58d0116c-3936-4d88-8565-1d5cf06c610f tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.014679 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58d0116c-3936-4d88-8565-1d5cf06c610f tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.016606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-19d42569-7a04-49ec-8b50-393fc2c01220 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.017073 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-19d42569-7a04-49ec-8b50-393fc2c01220 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.017847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-19d42569-7a04-49ec-8b50-393fc2c01220 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.018281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-19d42569-7a04-49ec-8b50-393fc2c01220 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.045381 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-19d42569-7a04-49ec-8b50-393fc2c01220 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/ips" status: 200 len: 150 microversion: 2.1 time: 0.039973 May 26 15:10:58.046531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 148/289] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:10:58 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:10:58.155297 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-58d0116c-3936-4d88-8565-1d5cf06c610f tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:58.163623 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-58d0116c-3936-4d88-8565-1d5cf06c610f tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1471 microversion: 2.1 time: 0.163428 May 26 15:10:58.164646 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 142/290] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:57 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:58.770320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:58.771647 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] [instance: d6492d5e-352b-4bc1-b655-8dad1cbf6911] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:58.779101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.779865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.780884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.781615 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.787946 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:58.788552 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:58.798469 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.799188 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.799544 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] HTTP exception thrown: Instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 could not be found. May 26 15:10:58.800361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.800942 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Request method failure captured: May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 HTTP/1.1 May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5hETjcL5MwtiErjV9QHEAZ9mneDZHoVvEKPBLAk4u1eW53WSNYb10CMtuO1qPKTn9Fb9Qi1fjE70H0C6sa8sUnCmyxPUOYFAWdFSimCQq-Ijd7to3_jwT93vJ9AS3JR9twD-0KOlUdUvZlDmL_KsdeqlH9jDNyUwf93xS3YyduPkNo May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 664448e66c54440f909ae6727ccc3deb May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesActionsTest-1583638605 May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:10:58.801669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/664448e66c54440f909ae6727ccc3deb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/664448e66c54440f909ae6727ccc3deb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_664448e66c54440f909ae6727ccc3deb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/664448e66c54440f909ae6727ccc3deb"}]}] May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesActionsTest-1583638605 May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 664448e66c54440f909ae6727ccc3deb May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesActionsTest-1583638605 May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesActionsTest-1583638605-project May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 1c54e915f4014d58ba28d6e6d5dd6ab6 May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesActionsTest-1583638605-project May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 could not be found. May 26 15:10:58.803207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': 'd6492d5e-352b-4bc1-b655-8dad1cbf6911'} May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 could not be found. May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:10:58.804326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 could not be found. May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 could not be found. May 26 15:10:58.805948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:10:58.807312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] Returning 404 to user: Instance d6492d5e-352b-4bc1-b655-8dad1cbf6911 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:10:58.808018 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7e7d182e-e1ba-4895-9f9f-4689c7b868b2 tempest-VolumesActionsTest-1583638605 tempest-VolumesActionsTest-1583638605-project] 10.222.0.46 "GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911" status: 404 len: 111 microversion: 2.1 time: 0.041594 May 26 15:10:58.812171 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 149/291] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:58 2022] GET /compute/v2.1/servers/d6492d5e-352b-4bc1-b655-8dad1cbf6911 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:58.966597 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1e90679c-4579-4c2f-bb03-43673238ee38 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:58.967316 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1e90679c-4579-4c2f-bb03-43673238ee38 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:58.974221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1e90679c-4579-4c2f-bb03-43673238ee38 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.974870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1e90679c-4579-4c2f-bb03-43673238ee38 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:58.975810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1e90679c-4579-4c2f-bb03-43673238ee38 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:58.976331 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1e90679c-4579-4c2f-bb03-43673238ee38 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:59.170438 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:59.180771 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:59.186861 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:59.197953 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-10f19db4-6213-44f7-878e-2075150dae37 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.406078 May 26 15:10:59.209047 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 143/292] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:10:58 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:10:59.214529 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-f4c403d3-0b80-41e2-874e-22d06865ad65 req-024ef037-f924-4404-a58f-1f2fe37fd1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f2b242-3ace-4b3a-aebe-61c49fe76bb7", "name": "network-vif-deleted", "tag": "736610d9-0031-4f0d-b417-d5c078104b49"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:59.249271 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f4c403d3-0b80-41e2-874e-22d06865ad65 req-024ef037-f924-4404-a58f-1f2fe37fd1f1 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:59.249766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f4c403d3-0b80-41e2-874e-22d06865ad65 req-024ef037-f924-4404-a58f-1f2fe37fd1f1 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:59.288824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-f4c403d3-0b80-41e2-874e-22d06865ad65 req-024ef037-f924-4404-a58f-1f2fe37fd1f1 service nova] Creating event network-vif-deleted:736610d9-0031-4f0d-b417-d5c078104b49 for instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 on hv-cinder-78836 May 26 15:10:59.299084 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-f4c403d3-0b80-41e2-874e-22d06865ad65 req-024ef037-f924-4404-a58f-1f2fe37fd1f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098214 May 26 15:10:59.313573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 144/293] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:10:59.324441 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:59.327198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:59.337355 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:59.338713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:59.339593 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:59.340127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:59.374541 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1e90679c-4579-4c2f-bb03-43673238ee38 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:59.387053 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:59.387984 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:59.388644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lazy-loading 'fault' on Instance uuid 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:10:59.407003 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1e90679c-4579-4c2f-bb03-43673238ee38 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.446224 May 26 15:10:59.409125 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 150/294] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:58 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:59.441653 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a511609a9a4875845a1056be541667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a272160dccba4f6b870efe8e25dae635', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:59.452180 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e698d1ea-643c-4990-850d-d400cdc6d5c4 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 200 len: 1305 microversion: 2.1 time: 0.132492 May 26 15:10:59.453139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 145/295] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:10:59 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 1305 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:59.484790 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4454b586-418e-4c21-9dbf-4f580c56d4ea tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5d7a372-93b8-41b0-aed0-fecd493e3e19"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:59.486494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4454b586-418e-4c21-9dbf-4f580c56d4ea tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:10:59.494857 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4454b586-418e-4c21-9dbf-4f580c56d4ea tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:59.495570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4454b586-418e-4c21-9dbf-4f580c56d4ea tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:10:59.496666 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4454b586-418e-4c21-9dbf-4f580c56d4ea tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:10:59.497876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4454b586-418e-4c21-9dbf-4f580c56d4ea tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.035358 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4454b586-418e-4c21-9dbf-4f580c56d4ea tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555110 May 26 15:11:00.036312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 151/296] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:10:59 2022] POST /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:11:00.218995 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:00.219639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:00.227074 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:00.228967 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.230127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:00.230640 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.404509 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:00.413338 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:00.416100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:00.417264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-dd13c8b3-d076-4461-a9ee-b81697620193 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.203867 May 26 15:11:00.417842 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 146/297] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:00 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:00.432851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-67439dd5-e27c-4d2d-b42a-1086fbc55c3c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:00.433593 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-67439dd5-e27c-4d2d-b42a-1086fbc55c3c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:00.441481 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-67439dd5-e27c-4d2d-b42a-1086fbc55c3c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:00.442014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-67439dd5-e27c-4d2d-b42a-1086fbc55c3c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.442803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-67439dd5-e27c-4d2d-b42a-1086fbc55c3c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:00.443269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-67439dd5-e27c-4d2d-b42a-1086fbc55c3c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.473229 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:00.474141 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] [instance: 24f2b242-3ace-4b3a-aebe-61c49fe76bb7] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:00.482103 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:00.483020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.484435 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:00.485205 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:00.501172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] HTTP exception thrown: Instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 could not be found. May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Request method failure captured: May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 HTTP/1.1 May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5hqdRgOnBpOFFx5fScBeLHn7btOAi2EBeeeuXr4vyWMSBTYFT_HyttA7DsEh64DgHyEdeUPZX-qcTwpdKiJfHowJDIIGhiH6qenlbX4JdLQhtFcI_ER41Os73cAuHf32c6TDG3Evv3FxRHVIoko_gZOVpAvRPM6u6VnaMyWrMI2C0M May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: a272160dccba4f6b870efe8e25dae635 May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-VolumesNegativeTest-765289766 May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:11:00.503382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a272160dccba4f6b870efe8e25dae635"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a272160dccba4f6b870efe8e25dae635"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a272160dccba4f6b870efe8e25dae635", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a272160dccba4f6b870efe8e25dae635"}]}] May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-VolumesNegativeTest-765289766 May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: a272160dccba4f6b870efe8e25dae635 May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-VolumesNegativeTest-765289766 May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-VolumesNegativeTest-765289766-project May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 10a511609a9a4875845a1056be541667 May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-VolumesNegativeTest-765289766-project May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 could not be found. May 26 15:11:00.504824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '24f2b242-3ace-4b3a-aebe-61c49fe76bb7'} May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 could not be found. May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:11:00.505620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 could not be found. May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 could not be found. May 26 15:11:00.506763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:11:00.510337 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] Returning 404 to user: Instance 24f2b242-3ace-4b3a-aebe-61c49fe76bb7 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:11:00.510337 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6dead303-f817-444b-8be2-f00524b88937 tempest-VolumesNegativeTest-765289766 tempest-VolumesNegativeTest-765289766-project] 10.222.0.46 "GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7" status: 404 len: 111 microversion: 2.1 time: 0.036599 May 26 15:11:00.523998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 147/298] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:00 2022] GET /compute/v2.1/servers/24f2b242-3ace-4b3a-aebe-61c49fe76bb7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:11:00.603521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-67439dd5-e27c-4d2d-b42a-1086fbc55c3c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:00.612504 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-67439dd5-e27c-4d2d-b42a-1086fbc55c3c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.185439 May 26 15:11:00.613538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 152/299] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:00 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:01.439796 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:01.440516 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:01.452193 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:01.458115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:01.459467 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:01.459978 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:01.634097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-65730163-633b-4f88-9f3b-ead4586963c8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:01.636041 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-65730163-633b-4f88-9f3b-ead4586963c8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:01.657267 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-65730163-633b-4f88-9f3b-ead4586963c8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:01.659437 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-65730163-633b-4f88-9f3b-ead4586963c8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:01.661200 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-65730163-633b-4f88-9f3b-ead4586963c8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:01.666484 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-65730163-633b-4f88-9f3b-ead4586963c8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:01.687476 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:01.690485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:01.702422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:01.716086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:01.727465 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3054e94c-e0cc-4150-b7e8-f681f93d3e91 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.287028 May 26 15:11:01.728098 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 148/300] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:01 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:01.862411 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-65730163-633b-4f88-9f3b-ead4586963c8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:01.870750 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-65730163-633b-4f88-9f3b-ead4586963c8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.241630 May 26 15:11:01.871933 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 153/301] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:01 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:02.747930 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:02.748632 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:02.770574 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:02.771226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:02.772096 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:02.772628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:02.894930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5dcb6eff-685e-43fe-aab0-4baef803f97a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:02.895936 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5dcb6eff-685e-43fe-aab0-4baef803f97a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:02.911337 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5dcb6eff-685e-43fe-aab0-4baef803f97a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:02.915587 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5dcb6eff-685e-43fe-aab0-4baef803f97a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:02.916807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5dcb6eff-685e-43fe-aab0-4baef803f97a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:02.926274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5dcb6eff-685e-43fe-aab0-4baef803f97a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:02.989247 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:03.000272 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:03.002360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:03.003716 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-76b20b35-83bc-45c6-933c-448f69e5235b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.261409 May 26 15:11:03.004427 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 149/302] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:02 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:03.163606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5dcb6eff-685e-43fe-aab0-4baef803f97a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:03.174133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5dcb6eff-685e-43fe-aab0-4baef803f97a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.289014 May 26 15:11:03.175023 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 154/303] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:02 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:04.028557 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:04.030209 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:04.045775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.046507 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:04.047575 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.048364 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:04.194837 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-82b2a811-06e0-402c-b05d-0b1778f495cb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:04.196689 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-82b2a811-06e0-402c-b05d-0b1778f495cb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:04.210220 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-82b2a811-06e0-402c-b05d-0b1778f495cb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.210924 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-82b2a811-06e0-402c-b05d-0b1778f495cb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:04.211959 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-82b2a811-06e0-402c-b05d-0b1778f495cb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.214069 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-82b2a811-06e0-402c-b05d-0b1778f495cb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:04.324590 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:04.336861 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:04.338875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:04.340173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a2aba3ac-58a9-40e4-94b7-5758867efa61 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.320401 May 26 15:11:04.340862 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 150/304] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:04 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:11:04.460526 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-82b2a811-06e0-402c-b05d-0b1778f495cb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:04.479643 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-82b2a811-06e0-402c-b05d-0b1778f495cb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.288015 May 26 15:11:04.480562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 155/305] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:04 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:04.770442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1f0b1be1-ec06-4b5f-8eae-28ef0d6a1831 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:04.777799 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f0b1be1-ec06-4b5f-8eae-28ef0d6a1831 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.779184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1f0b1be1-ec06-4b5f-8eae-28ef0d6a1831 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:04.857380 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1f0b1be1-ec06-4b5f-8eae-28ef0d6a1831 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Going to try to stop instance {{(pid=117723) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 15:11:04.931708 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1f0b1be1-ec06-4b5f-8eae-28ef0d6a1831 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/action" status: 202 len: 0 microversion: 2.1 time: 0.165996 May 26 15:11:04.935477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 151/306] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:11:04 2022] POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:11:04.943161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bffefb42-6ebe-4202-9213-a2edca9eba94 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:04.944301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bffefb42-6ebe-4202-9213-a2edca9eba94 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:04.960337 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bffefb42-6ebe-4202-9213-a2edca9eba94 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.960712 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bffefb42-6ebe-4202-9213-a2edca9eba94 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:04.966988 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bffefb42-6ebe-4202-9213-a2edca9eba94 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:04.967478 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bffefb42-6ebe-4202-9213-a2edca9eba94 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:05.128864 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bffefb42-6ebe-4202-9213-a2edca9eba94 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:05.138250 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bffefb42-6ebe-4202-9213-a2edca9eba94 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.200855 May 26 15:11:05.140190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 156/307] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:04 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:05.399978 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:05.404805 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:05.427029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:05.429923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:05.434859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:05.438338 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:05.538922 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1ed019bb-1e8a-48e2-b141-d75f3e61addc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:05.545747 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1ed019bb-1e8a-48e2-b141-d75f3e61addc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:05.572740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1ed019bb-1e8a-48e2-b141-d75f3e61addc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:05.575655 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1ed019bb-1e8a-48e2-b141-d75f3e61addc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:05.578912 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1ed019bb-1e8a-48e2-b141-d75f3e61addc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:05.582138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1ed019bb-1e8a-48e2-b141-d75f3e61addc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:05.850262 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:05.871061 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:05.874104 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:05.875854 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6bdb5324-a047-4cf3-95ed-628910b2ae26 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.519247 May 26 15:11:05.877306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 152/308] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:05 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:05.939761 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1ed019bb-1e8a-48e2-b141-d75f3e61addc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:05.959676 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1ed019bb-1e8a-48e2-b141-d75f3e61addc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.425154 May 26 15:11:05.963439 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 157/309] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:05 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:06.158484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-03b40949-e0f8-4329-b9d4-32d5b4a5b452 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:06.159411 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-03b40949-e0f8-4329-b9d4-32d5b4a5b452 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:06.166375 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-03b40949-e0f8-4329-b9d4-32d5b4a5b452 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:06.167663 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-03b40949-e0f8-4329-b9d4-32d5b4a5b452 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:06.169503 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-03b40949-e0f8-4329-b9d4-32d5b4a5b452 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:06.170350 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-03b40949-e0f8-4329-b9d4-32d5b4a5b452 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:06.390874 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-03b40949-e0f8-4329-b9d4-32d5b4a5b452 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:06.407830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-03b40949-e0f8-4329-b9d4-32d5b4a5b452 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.246257 May 26 15:11:06.410508 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 153/310] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:06 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:06.897004 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:06.897982 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:06.907834 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:06.912465 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:06.913655 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:06.914671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:06.980421 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6ea08b85-3e9e-4024-9f63-43ff03baec8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:06.981562 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6ea08b85-3e9e-4024-9f63-43ff03baec8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:06.991977 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ea08b85-3e9e-4024-9f63-43ff03baec8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:06.994099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ea08b85-3e9e-4024-9f63-43ff03baec8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.015122 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ea08b85-3e9e-4024-9f63-43ff03baec8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.015691 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6ea08b85-3e9e-4024-9f63-43ff03baec8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.360305 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6ea08b85-3e9e-4024-9f63-43ff03baec8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:07.383410 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:07.394955 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6ea08b85-3e9e-4024-9f63-43ff03baec8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.418733 May 26 15:11:07.395786 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 154/311] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:06 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:07.398592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:07.403677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:07.405150 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c83985ea-b748-4724-bf00-314659824bae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.512522 May 26 15:11:07.418657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 158/312] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:06 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:07.427999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-dc620498-fcfd-4378-a1a9-31d1a9ba13b8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:07.429286 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-dc620498-fcfd-4378-a1a9-31d1a9ba13b8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:07.443825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dc620498-fcfd-4378-a1a9-31d1a9ba13b8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.444287 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dc620498-fcfd-4378-a1a9-31d1a9ba13b8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.446370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dc620498-fcfd-4378-a1a9-31d1a9ba13b8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:07.446976 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dc620498-fcfd-4378-a1a9-31d1a9ba13b8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:07.699902 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dc620498-fcfd-4378-a1a9-31d1a9ba13b8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:07.716351 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-dc620498-fcfd-4378-a1a9-31d1a9ba13b8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.292071 May 26 15:11:07.722381 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 155/313] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:07 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:08.414586 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-cdfad704-a7d1-4310-83e7-9df40cf74210 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:08.415965 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cdfad704-a7d1-4310-83e7-9df40cf74210 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:08.426627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:08.427684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:08.439665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cdfad704-a7d1-4310-83e7-9df40cf74210 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:08.440973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:08.442057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:08.442799 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cdfad704-a7d1-4310-83e7-9df40cf74210 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:08.443856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:08.444888 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cdfad704-a7d1-4310-83e7-9df40cf74210 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:08.446548 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cdfad704-a7d1-4310-83e7-9df40cf74210 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:08.446876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:08.686002 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:08.705713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:08.716081 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:08.718036 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-68ded180-de89-45bc-a719-5acf4b931103 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.295233 May 26 15:11:08.738821 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 156/314] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:08 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:08.745327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-81552bbc-67a3-43a8-8c36-b831d3735a68 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:08.746345 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-81552bbc-67a3-43a8-8c36-b831d3735a68 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:08.753690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-81552bbc-67a3-43a8-8c36-b831d3735a68 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:08.754500 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-81552bbc-67a3-43a8-8c36-b831d3735a68 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:08.755539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-81552bbc-67a3-43a8-8c36-b831d3735a68 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:08.756211 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-81552bbc-67a3-43a8-8c36-b831d3735a68 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:08.788692 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-cdfad704-a7d1-4310-83e7-9df40cf74210 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:08.826119 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:08.830290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-cdfad704-a7d1-4310-83e7-9df40cf74210 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.418395 May 26 15:11:08.831595 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 159/315] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:08 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:08.979084 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-81552bbc-67a3-43a8-8c36-b831d3735a68 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:09.003214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-81552bbc-67a3-43a8-8c36-b831d3735a68 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.262263 May 26 15:11:09.003807 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 157/316] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:08 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:09.752613 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:09.754668 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:09.783052 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:09.783575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:09.789976 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:09.790805 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:09.887168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-24c86eaa-03df-4b6e-816f-cc4fb9659354 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:09.887881 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-24c86eaa-03df-4b6e-816f-cc4fb9659354 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:09.908295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24c86eaa-03df-4b6e-816f-cc4fb9659354 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:09.909170 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24c86eaa-03df-4b6e-816f-cc4fb9659354 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:09.910265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24c86eaa-03df-4b6e-816f-cc4fb9659354 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:09.922179 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24c86eaa-03df-4b6e-816f-cc4fb9659354 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:10.292271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:10.302740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:10.308102 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:10.308949 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bd194e07-cc7d-429a-9ae1-b107ae96969d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.567890 May 26 15:11:10.328993 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 160/317] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:09 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:10.334201 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c2999a68-7a90-4257-b7ff-f8f0235a33ae tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:10.334834 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c2999a68-7a90-4257-b7ff-f8f0235a33ae tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:10.363952 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c2999a68-7a90-4257-b7ff-f8f0235a33ae tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:10.364725 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c2999a68-7a90-4257-b7ff-f8f0235a33ae tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:10.365771 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c2999a68-7a90-4257-b7ff-f8f0235a33ae tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:10.366512 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c2999a68-7a90-4257-b7ff-f8f0235a33ae tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:10.387224 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-24c86eaa-03df-4b6e-816f-cc4fb9659354 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:10.400563 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-24c86eaa-03df-4b6e-816f-cc4fb9659354 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.518607 May 26 15:11:10.401467 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 158/318] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:09 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:10.567234 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c2999a68-7a90-4257-b7ff-f8f0235a33ae tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:10.576407 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c2999a68-7a90-4257-b7ff-f8f0235a33ae tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.246152 May 26 15:11:10.576993 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 161/319] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:10 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:11.329950 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:11.331329 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:11.343920 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:11.344542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:11.347809 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:11.348658 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:11.418003 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7a0bc951-9061-48ef-addd-eb0b36ba2909 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:11.418720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7a0bc951-9061-48ef-addd-eb0b36ba2909 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:11.431311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7a0bc951-9061-48ef-addd-eb0b36ba2909 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:11.431772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7a0bc951-9061-48ef-addd-eb0b36ba2909 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:11.434402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7a0bc951-9061-48ef-addd-eb0b36ba2909 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:11.435068 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7a0bc951-9061-48ef-addd-eb0b36ba2909 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:11.640662 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:11.649705 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:11.651241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:11.652423 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ab78ada2-d249-49c2-a796-2d439ca62a74 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1739 microversion: 2.20 time: 0.327914 May 26 15:11:11.659465 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 159/320] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:11 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:11.659465 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c84b75e2-5650-4919-8e16-0142f97b183c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:11.659465 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c84b75e2-5650-4919-8e16-0142f97b183c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:11.664726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c84b75e2-5650-4919-8e16-0142f97b183c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:11.665041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c84b75e2-5650-4919-8e16-0142f97b183c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:11.665860 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c84b75e2-5650-4919-8e16-0142f97b183c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:11.666306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c84b75e2-5650-4919-8e16-0142f97b183c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:11.684538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7a0bc951-9061-48ef-addd-eb0b36ba2909 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:11.692012 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7a0bc951-9061-48ef-addd-eb0b36ba2909 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.278829 May 26 15:11:11.692711 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 162/321] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:11 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:11.898258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c84b75e2-5650-4919-8e16-0142f97b183c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:11.908117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c84b75e2-5650-4919-8e16-0142f97b183c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.253473 May 26 15:11:11.920164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 160/322] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:11 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:12.671364 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:12.672714 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:12.679915 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:12.680519 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:12.681495 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:12.682046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:12.710291 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b5a26ac1-a6b1-4383-a2ac-ccbf0db21c93 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:12.710979 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b5a26ac1-a6b1-4383-a2ac-ccbf0db21c93 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:12.721725 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5a26ac1-a6b1-4383-a2ac-ccbf0db21c93 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:12.722180 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5a26ac1-a6b1-4383-a2ac-ccbf0db21c93 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:12.722958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5a26ac1-a6b1-4383-a2ac-ccbf0db21c93 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:12.723391 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b5a26ac1-a6b1-4383-a2ac-ccbf0db21c93 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:13.248282 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:13.251568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b5a26ac1-a6b1-4383-a2ac-ccbf0db21c93 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:13.263408 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b5a26ac1-a6b1-4383-a2ac-ccbf0db21c93 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.557000 May 26 15:11:13.269044 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:13.271032 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:13.272598 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-fd9e9c64-f813-4883-ab51-c0635a7d7f5d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1721 microversion: 2.20 time: 0.605317 May 26 15:11:13.273433 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 163/323] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:12 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1721 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:13.275399 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 161/324] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:12 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:13.281181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c8341bf3-bc52-415b-8f09-1ec8026a6188 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:13.283482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c8341bf3-bc52-415b-8f09-1ec8026a6188 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:13.301941 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8341bf3-bc52-415b-8f09-1ec8026a6188 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:13.303210 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8341bf3-bc52-415b-8f09-1ec8026a6188 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:13.304238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8341bf3-bc52-415b-8f09-1ec8026a6188 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:13.306287 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8341bf3-bc52-415b-8f09-1ec8026a6188 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:13.543688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d176899e-033e-4eac-86a0-35e28ee0fef9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: .version_select at 0x7ff9668cfd30>, body: {"keypair": {"name": "tempest-keypair-202950527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1616a+xjlxKqr+up74zhBo817JJvb8dO/GSQdbDu/4+nAHrqZeMMir05svKcJVKG2S8uJWScZwg5Z8C9hTSrLseTEV2YNUOHi0Jm+fLG/5UMRAjYpxghRVVMFwgMyy6A=="}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:13.544650 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c8341bf3-bc52-415b-8f09-1ec8026a6188 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:13.554053 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c8341bf3-bc52-415b-8f09-1ec8026a6188 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.278444 May 26 15:11:13.554671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 164/325] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:13 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:13.575535 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:13.593422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-d176899e-033e-4eac-86a0-35e28ee0fef9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for project 9780d0cae62c4f5088060b530571ebb3. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:11:13.598696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-d176899e-033e-4eac-86a0-35e28ee0fef9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for user 2ce5b5d5a12743bc80a4b191c24ff52f and project 9780d0cae62c4f5088060b530571ebb3. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:11:13.672263 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d176899e-033e-4eac-86a0-35e28ee0fef9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139302 May 26 15:11:13.675914 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 162/326] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:11:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:11:14.280490 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5a333bd5-5786-41b4-9373-bc3468b84b34 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:14.281128 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5a333bd5-5786-41b4-9373-bc3468b84b34 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:14.294373 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5a333bd5-5786-41b4-9373-bc3468b84b34 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:14.295192 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5a333bd5-5786-41b4-9373-bc3468b84b34 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:14.295983 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5a333bd5-5786-41b4-9373-bc3468b84b34 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:14.296424 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5a333bd5-5786-41b4-9373-bc3468b84b34 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:14.298708 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:14.299347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:14.315110 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:14.317198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:14.318330 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:14.319057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:14.593497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5a333bd5-5786-41b4-9373-bc3468b84b34 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:14.607899 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5a333bd5-5786-41b4-9373-bc3468b84b34 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.331109 May 26 15:11:14.609782 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 165/327] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:14 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:14.624626 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-04ba10bf-15d6-4614-9337-2ad72d964bd4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:14.625575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-04ba10bf-15d6-4614-9337-2ad72d964bd4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:14.637063 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-04ba10bf-15d6-4614-9337-2ad72d964bd4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:14.639173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-04ba10bf-15d6-4614-9337-2ad72d964bd4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:14.640479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-04ba10bf-15d6-4614-9337-2ad72d964bd4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:14.641259 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-04ba10bf-15d6-4614-9337-2ad72d964bd4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:14.661674 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:14.673251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:14.676704 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:14.680718 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-61cb9281-b616-481b-9dce-c3910bbb841e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1721 microversion: 2.20 time: 0.388008 May 26 15:11:14.694389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 163/328] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:14 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:14.893199 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-04ba10bf-15d6-4614-9337-2ad72d964bd4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:14.909151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-04ba10bf-15d6-4614-9337-2ad72d964bd4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.297248 May 26 15:11:14.921798 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 166/329] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:14 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:15.632742 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d84de16e-45e9-4c7a-b2ba-a3a5efa73bf4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:15.634044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d84de16e-45e9-4c7a-b2ba-a3a5efa73bf4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:15.654789 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d84de16e-45e9-4c7a-b2ba-a3a5efa73bf4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:15.658184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d84de16e-45e9-4c7a-b2ba-a3a5efa73bf4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:15.659039 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d84de16e-45e9-4c7a-b2ba-a3a5efa73bf4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:15.659482 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d84de16e-45e9-4c7a-b2ba-a3a5efa73bf4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:15.699688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:15.700328 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:15.708450 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:15.709297 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:15.709788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:15.710122 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:16.011835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d84de16e-45e9-4c7a-b2ba-a3a5efa73bf4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:16.030907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d84de16e-45e9-4c7a-b2ba-a3a5efa73bf4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.404258 May 26 15:11:16.032160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 164/330] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:15 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:16.037370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-24f0a7d0-a426-4554-b450-ee8e1fb848c0 req-6bc70e57-f1b3-4fd0-bef8-064a343ef330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06cf01b4-e458-498b-990e-33b4171e1a14", "name": "network-vif-unplugged", "status": "completed", "tag": "2e5306c2-86c5-4899-9abd-3ff6e390eb95"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:16.047644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-24f0a7d0-a426-4554-b450-ee8e1fb848c0 req-6bc70e57-f1b3-4fd0-bef8-064a343ef330 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:16.048807 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-24f0a7d0-a426-4554-b450-ee8e1fb848c0 req-6bc70e57-f1b3-4fd0-bef8-064a343ef330 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:16.064737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-24f0a7d0-a426-4554-b450-ee8e1fb848c0 req-6bc70e57-f1b3-4fd0-bef8-064a343ef330 service nova] Creating event network-vif-unplugged:2e5306c2-86c5-4899-9abd-3ff6e390eb95 for instance 06cf01b4-e458-498b-990e-33b4171e1a14 on hv-cinder-78836 May 26 15:11:16.068160 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:16.083928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:16.089596 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:16.089993 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-24f0a7d0-a426-4554-b450-ee8e1fb848c0 req-6bc70e57-f1b3-4fd0-bef8-064a343ef330 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055423 May 26 15:11:16.090998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 165/331] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:16.096702 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ff2cba59-9932-4c02-a1db-a1b8c901afc5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1721 microversion: 2.20 time: 0.400971 May 26 15:11:16.105788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 167/332] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:15 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1721 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:11:16.112049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4ec3ff5e-c9a1-41dd-8e7c-f54097d2aa7b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:16.112976 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4ec3ff5e-c9a1-41dd-8e7c-f54097d2aa7b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:16.118007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1673945598", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf638e18-3aa1-4ba6-b2c0-e624f717acb0"}], "security_groups": [{"name": "tempest-securitygroup--700323435"}], "key_name": "tempest-keypair-202950527", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:16.120182 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4ec3ff5e-c9a1-41dd-8e7c-f54097d2aa7b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:16.120905 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4ec3ff5e-c9a1-41dd-8e7c-f54097d2aa7b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:16.122276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4ec3ff5e-c9a1-41dd-8e7c-f54097d2aa7b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:16.123020 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4ec3ff5e-c9a1-41dd-8e7c-f54097d2aa7b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:16.325486 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] validate_networks() for [('bf638e18-3aa1-4ba6-b2c0-e624f717acb0', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:11:16.424168 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4ec3ff5e-c9a1-41dd-8e7c-f54097d2aa7b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:16.435638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4ec3ff5e-c9a1-41dd-8e7c-f54097d2aa7b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.328653 May 26 15:11:16.439689 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 168/333] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:16 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:16.894204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:11:16.895555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:11:16.896461 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:11:16.896885 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:11:16.897295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:11:16.909643 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:16.910472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:16.911272 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:16.911718 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:16.921485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:16.934184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for project 9780d0cae62c4f5088060b530571ebb3. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:11:16.939263 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for user 2ce5b5d5a12743bc80a4b191c24ff52f and project 9780d0cae62c4f5088060b530571ebb3. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:11:16.953760 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:11:16.959104 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:11:17.019142 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3e348ce8-5a44-42dc-9105-c35457feab75 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.921976 May 26 15:11:17.020250 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 166/334] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:11:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:11:17.030946 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e5580e50-daf8-445c-9443-7880dbeee731 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:17.031686 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e5580e50-daf8-445c-9443-7880dbeee731 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:17.051117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-44220d86-4c50-456b-af9a-40fed1af0769 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:17.052192 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-44220d86-4c50-456b-af9a-40fed1af0769 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:17.075782 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44220d86-4c50-456b-af9a-40fed1af0769 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:17.076456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44220d86-4c50-456b-af9a-40fed1af0769 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:17.081791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44220d86-4c50-456b-af9a-40fed1af0769 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:17.082488 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-44220d86-4c50-456b-af9a-40fed1af0769 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:17.118860 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e5580e50-daf8-445c-9443-7880dbeee731 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:17.128443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e5580e50-daf8-445c-9443-7880dbeee731 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1241 microversion: 2.1 time: 0.101839 May 26 15:11:17.129025 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 169/335] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:17 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:17.140983 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:17.141660 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:17.161978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:17.162688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:17.163625 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:17.165564 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:17.271228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-44220d86-4c50-456b-af9a-40fed1af0769 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:17.295826 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-44220d86-4c50-456b-af9a-40fed1af0769 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.251512 May 26 15:11:17.298130 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 167/336] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:17 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:17.425436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:17.437506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:17.447494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:17.448856 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7b686b75-c059-460e-8934-ea8825e74fba tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1664 microversion: 2.20 time: 0.318780 May 26 15:11:17.461479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 170/337] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:17 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1664 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:17.461835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3adfab43-072d-41d4-9cba-498459524460 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:17.461835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3adfab43-072d-41d4-9cba-498459524460 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:17.464101 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3adfab43-072d-41d4-9cba-498459524460 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:17.467487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3adfab43-072d-41d4-9cba-498459524460 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:17.468524 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3adfab43-072d-41d4-9cba-498459524460 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:17.468989 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3adfab43-072d-41d4-9cba-498459524460 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:17.472685 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e05a9cdf-6e2d-4691-9b0a-1a3dc4c28a32 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e87c1777-b08c-4554-ba93-e391e0c8bfd6"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:17.474608 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e05a9cdf-6e2d-4691-9b0a-1a3dc4c28a32 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:17.486282 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e05a9cdf-6e2d-4691-9b0a-1a3dc4c28a32 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:17.491756 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e05a9cdf-6e2d-4691-9b0a-1a3dc4c28a32 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:17.493736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e05a9cdf-6e2d-4691-9b0a-1a3dc4c28a32 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:17.494493 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e05a9cdf-6e2d-4691-9b0a-1a3dc4c28a32 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:17.779303 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3adfab43-072d-41d4-9cba-498459524460 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:17.787473 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3adfab43-072d-41d4-9cba-498459524460 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.336195 May 26 15:11:17.788049 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 168/338] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:17 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:18.037736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e05a9cdf-6e2d-4691-9b0a-1a3dc4c28a32 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.570029 May 26 15:11:18.046070 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 171/339] 10.222.0.46 () {62 vars in 1363 bytes} [Thu May 26 15:11:17 2022] POST /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments => generated 188 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:11:18.150384 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-92699057-5408-4f61-9558-6cf1318659f6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:18.152208 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-92699057-5408-4f61-9558-6cf1318659f6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:18.159508 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92699057-5408-4f61-9558-6cf1318659f6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.160301 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92699057-5408-4f61-9558-6cf1318659f6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.161230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92699057-5408-4f61-9558-6cf1318659f6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.162198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92699057-5408-4f61-9558-6cf1318659f6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.205401 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1b1647f0-5fd1-4d46-a5c6-f051935d4b42 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:18.206007 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1b1647f0-5fd1-4d46-a5c6-f051935d4b42 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:18.219113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1b1647f0-5fd1-4d46-a5c6-f051935d4b42 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.219822 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1b1647f0-5fd1-4d46-a5c6-f051935d4b42 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.222339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1b1647f0-5fd1-4d46-a5c6-f051935d4b42 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.222955 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1b1647f0-5fd1-4d46-a5c6-f051935d4b42 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.263420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-92699057-5408-4f61-9558-6cf1318659f6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:18.281987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-92699057-5408-4f61-9558-6cf1318659f6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1293 microversion: 2.1 time: 0.138160 May 26 15:11:18.290643 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 169/340] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:18 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1293 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:18.323131 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b73f6e35-2ea4-410d-8c96-833207fe7d7f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:18.323899 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b73f6e35-2ea4-410d-8c96-833207fe7d7f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:18.339462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b73f6e35-2ea4-410d-8c96-833207fe7d7f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.340136 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b73f6e35-2ea4-410d-8c96-833207fe7d7f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.341196 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b73f6e35-2ea4-410d-8c96-833207fe7d7f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.341675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b73f6e35-2ea4-410d-8c96-833207fe7d7f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.403910 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1b1647f0-5fd1-4d46-a5c6-f051935d4b42 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/action" status: 202 len: 0 microversion: 2.20 time: 0.202259 May 26 15:11:18.409275 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 172/341] 10.222.0.46 () {62 vars in 1318 bytes} [Thu May 26 15:11:18 2022] POST /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:11:18.416178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:18.416816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:18.437339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.437820 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.438604 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.439043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.657640 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b73f6e35-2ea4-410d-8c96-833207fe7d7f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:18.676747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b73f6e35-2ea4-410d-8c96-833207fe7d7f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.358273 May 26 15:11:18.681942 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 170/342] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:18 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:18.806538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a9221b04-a298-4a1d-92f2-65dd3b630403 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:18.807489 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a9221b04-a298-4a1d-92f2-65dd3b630403 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:18.820769 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a9221b04-a298-4a1d-92f2-65dd3b630403 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.821293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a9221b04-a298-4a1d-92f2-65dd3b630403 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.822211 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a9221b04-a298-4a1d-92f2-65dd3b630403 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:18.822661 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a9221b04-a298-4a1d-92f2-65dd3b630403 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:18.937045 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:18.940702 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:18.951365 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:18.967994 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:18.969504 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ae6eaa44-2e0f-4010-bddf-6da7f2dd6638 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1750 microversion: 2.20 time: 0.557173 May 26 15:11:18.975817 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 173/343] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:18 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1750 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:19.165805 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a9221b04-a298-4a1d-92f2-65dd3b630403 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:19.181751 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a9221b04-a298-4a1d-92f2-65dd3b630403 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.378833 May 26 15:11:19.187401 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 171/344] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:18 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:19.300111 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-03ed951a-01ec-4ee2-824d-c511afb28c8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:19.301317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-03ed951a-01ec-4ee2-824d-c511afb28c8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:19.326756 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-03ed951a-01ec-4ee2-824d-c511afb28c8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:19.331140 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-03ed951a-01ec-4ee2-824d-c511afb28c8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:19.332016 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-03ed951a-01ec-4ee2-824d-c511afb28c8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:19.333693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-03ed951a-01ec-4ee2-824d-c511afb28c8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:19.447555 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-03ed951a-01ec-4ee2-824d-c511afb28c8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:19.456362 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-03ed951a-01ec-4ee2-824d-c511afb28c8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1299 microversion: 2.1 time: 0.161273 May 26 15:11:19.462985 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 174/345] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:19 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:19.699676 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2c220d11-baf0-49af-990e-a90fc86b763c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:19.700501 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2c220d11-baf0-49af-990e-a90fc86b763c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:19.716800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2c220d11-baf0-49af-990e-a90fc86b763c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:19.723646 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2c220d11-baf0-49af-990e-a90fc86b763c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:19.729242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2c220d11-baf0-49af-990e-a90fc86b763c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:19.733007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2c220d11-baf0-49af-990e-a90fc86b763c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:19.995480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:19.996431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:20.005648 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:20.007603 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:20.008169 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:20.009193 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:20.009807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:20.275533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2c220d11-baf0-49af-990e-a90fc86b763c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:20.283989 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2c220d11-baf0-49af-990e-a90fc86b763c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.588936 May 26 15:11:20.290248 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 172/346] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:19 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:20.304174 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-822968a9-5554-4308-9b1e-22e88c77a58d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:20.305099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-822968a9-5554-4308-9b1e-22e88c77a58d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:20.313284 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-822968a9-5554-4308-9b1e-22e88c77a58d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:20.314206 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-822968a9-5554-4308-9b1e-22e88c77a58d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:20.315266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-822968a9-5554-4308-9b1e-22e88c77a58d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:20.316444 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-822968a9-5554-4308-9b1e-22e88c77a58d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:20.355887 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:20.385416 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:20.390047 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:20.393042 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d23e8b08-d2e5-4518-9448-42f1a376fd49 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1750 microversion: 2.20 time: 0.401770 May 26 15:11:20.394541 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 175/347] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:19 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1750 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:11:20.488934 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-aa22e1ec-2947-40c5-a4b4-c534ccbeb56b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:20.490198 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-aa22e1ec-2947-40c5-a4b4-c534ccbeb56b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:20.497955 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-aa22e1ec-2947-40c5-a4b4-c534ccbeb56b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:20.498935 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-aa22e1ec-2947-40c5-a4b4-c534ccbeb56b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:20.500187 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-aa22e1ec-2947-40c5-a4b4-c534ccbeb56b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:20.500850 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-aa22e1ec-2947-40c5-a4b4-c534ccbeb56b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:20.610292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-aa22e1ec-2947-40c5-a4b4-c534ccbeb56b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:20.611741 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-822968a9-5554-4308-9b1e-22e88c77a58d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:20.623206 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-aa22e1ec-2947-40c5-a4b4-c534ccbeb56b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1299 microversion: 2.1 time: 0.147633 May 26 15:11:20.623752 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-822968a9-5554-4308-9b1e-22e88c77a58d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.323329 May 26 15:11:20.633954 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 173/348] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:20 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:20.636178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 176/349] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:20 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:21.084369 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1980602586", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "networks": [{"uuid": "e5c3a41d-5502-412d-93bc-4ee7162401e0"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:21.149187 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] validate_networks() for [('e5c3a41d-5502-412d-93bc-4ee7162401e0', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:11:21.307585 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f38857a6-84f2-4eb0-a4b2-d019ed31cd53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:21.308616 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f38857a6-84f2-4eb0-a4b2-d019ed31cd53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:21.315874 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f38857a6-84f2-4eb0-a4b2-d019ed31cd53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:21.316462 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f38857a6-84f2-4eb0-a4b2-d019ed31cd53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:21.317531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f38857a6-84f2-4eb0-a4b2-d019ed31cd53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:21.318277 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f38857a6-84f2-4eb0-a4b2-d019ed31cd53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:21.719219 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f38857a6-84f2-4eb0-a4b2-d019ed31cd53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:21.733929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f38857a6-84f2-4eb0-a4b2-d019ed31cd53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.431036 May 26 15:11:21.735801 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 177/350] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:21 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:21.755281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:21.756333 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:21.762907 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:21.763507 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:21.764285 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:21.764887 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.037139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:11:22.037715 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:11:22.042673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:11:22.043169 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:11:22.043598 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:11:22.058422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.059191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.060462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.061066 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.081009 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Getting quotas for project d58410e922bd46418c9e93bf61b348f8. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:11:22.086597 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Getting quotas for user dfa425e42202421c9e1c8564456c67f7 and project d58410e922bd46418c9e93bf61b348f8. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:11:22.102325 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:11:22.104790 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:11:22.113049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:22.137719 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:22.141050 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:22.144791 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1733eae4-3c60-4864-8469-d661a1d7789a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.405656 May 26 15:11:22.146602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 178/351] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:21 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:22.178937 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f56d5880-db58-480a-a3d8-5c46f6b98d3c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:22.180987 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f56d5880-db58-480a-a3d8-5c46f6b98d3c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:22.197521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f56d5880-db58-480a-a3d8-5c46f6b98d3c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.197982 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f56d5880-db58-480a-a3d8-5c46f6b98d3c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.200551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f56d5880-db58-480a-a3d8-5c46f6b98d3c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.201007 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f56d5880-db58-480a-a3d8-5c46f6b98d3c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.204558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-791983f8-bb4d-4caa-9f33-83bff5dc9669 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125729 May 26 15:11:22.205411 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 174/352] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:11:22.211594 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d29c2ed2-776f-4e0e-bb45-198e570e51fd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:22.212485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d29c2ed2-776f-4e0e-bb45-198e570e51fd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:22.222290 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d29c2ed2-776f-4e0e-bb45-198e570e51fd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.223016 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d29c2ed2-776f-4e0e-bb45-198e570e51fd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.224199 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d29c2ed2-776f-4e0e-bb45-198e570e51fd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.224809 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d29c2ed2-776f-4e0e-bb45-198e570e51fd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.813039 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f56d5880-db58-480a-a3d8-5c46f6b98d3c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:22.829525 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d29c2ed2-776f-4e0e-bb45-198e570e51fd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:22.836693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f56d5880-db58-480a-a3d8-5c46f6b98d3c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.674329 May 26 15:11:22.848002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 179/353] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:22 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:22.850699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d29c2ed2-776f-4e0e-bb45-198e570e51fd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.643908 May 26 15:11:22.851658 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 175/354] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:22 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:22.856258 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9d621f1b-739f-45d0-8586-f0fd2f99c379 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:22.866155 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-24f95f3d-da31-4af0-8735-309dc25bd0da req-0971a25f-49d7-4071-b0aa-f8a921c220e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f", "tag": "2b9adcd0-48a4-4233-a3fb-694dc9e1657f"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:22.874457 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9d621f1b-739f-45d0-8586-f0fd2f99c379 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:22.903620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-24f95f3d-da31-4af0-8735-309dc25bd0da req-0971a25f-49d7-4071-b0aa-f8a921c220e9 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.904084 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-24f95f3d-da31-4af0-8735-309dc25bd0da req-0971a25f-49d7-4071-b0aa-f8a921c220e9 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.938907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-24f95f3d-da31-4af0-8735-309dc25bd0da req-0971a25f-49d7-4071-b0aa-f8a921c220e9 service nova] Creating event network-changed:2b9adcd0-48a4-4233-a3fb-694dc9e1657f for instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f on hv-cinder-78836 May 26 15:11:22.951580 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-24f95f3d-da31-4af0-8735-309dc25bd0da req-0971a25f-49d7-4071-b0aa-f8a921c220e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098457 May 26 15:11:22.952498 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 176/355] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:22.966416 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-85a62d16-324b-47e7-a57c-3eabc40884ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:22.967651 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-85a62d16-324b-47e7-a57c-3eabc40884ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:22.984709 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-85a62d16-324b-47e7-a57c-3eabc40884ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.985289 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-85a62d16-324b-47e7-a57c-3eabc40884ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.985745 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9d621f1b-739f-45d0-8586-f0fd2f99c379 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:22.986164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-85a62d16-324b-47e7-a57c-3eabc40884ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:22.986715 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-85a62d16-324b-47e7-a57c-3eabc40884ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:22.995388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9d621f1b-739f-45d0-8586-f0fd2f99c379 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1219 microversion: 2.1 time: 0.146215 May 26 15:11:22.996382 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 180/356] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:22 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:23.166859 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:23.167792 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:23.181277 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:23.190133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:23.191852 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:23.193008 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:23.319570 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-85a62d16-324b-47e7-a57c-3eabc40884ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:23.332773 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-85a62d16-324b-47e7-a57c-3eabc40884ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.378995 May 26 15:11:23.333693 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 177/357] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:22 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:23.481943 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:23.501060 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:23.503114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:23.504375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0f8f33ca-407a-44d2-9ca3-a5dd7633ec62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.342372 May 26 15:11:23.510294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 181/358] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:23 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:11:23.853751 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fffd563e-c4f7-4e2f-8845-efad285c14a7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:23.854786 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fffd563e-c4f7-4e2f-8845-efad285c14a7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:23.866224 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fffd563e-c4f7-4e2f-8845-efad285c14a7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:23.867359 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fffd563e-c4f7-4e2f-8845-efad285c14a7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:23.868390 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fffd563e-c4f7-4e2f-8845-efad285c14a7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:23.869051 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fffd563e-c4f7-4e2f-8845-efad285c14a7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:23.870498 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4ccf5ea7-6219-49ed-8b88-0084469799bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:23.871530 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4ccf5ea7-6219-49ed-8b88-0084469799bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:23.891859 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4ccf5ea7-6219-49ed-8b88-0084469799bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:23.893347 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4ccf5ea7-6219-49ed-8b88-0084469799bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:23.895001 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4ccf5ea7-6219-49ed-8b88-0084469799bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:23.895595 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4ccf5ea7-6219-49ed-8b88-0084469799bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.093241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fffd563e-c4f7-4e2f-8845-efad285c14a7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:24.104259 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fffd563e-c4f7-4e2f-8845-efad285c14a7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.254512 May 26 15:11:24.105493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 178/359] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:23 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:24.111032 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-01a1c3c6-71b8-412a-814e-4cadfd26fb18 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:24.111886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-01a1c3c6-71b8-412a-814e-4cadfd26fb18 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:24.115578 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4ccf5ea7-6219-49ed-8b88-0084469799bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:24.130367 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01a1c3c6-71b8-412a-814e-4cadfd26fb18 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:24.130682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4ccf5ea7-6219-49ed-8b88-0084469799bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.259524 May 26 15:11:24.131540 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 182/360] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:23 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:24.132048 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01a1c3c6-71b8-412a-814e-4cadfd26fb18 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.133683 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01a1c3c6-71b8-412a-814e-4cadfd26fb18 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:24.134110 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01a1c3c6-71b8-412a-814e-4cadfd26fb18 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.204258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-01a1c3c6-71b8-412a-814e-4cadfd26fb18 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:24.213807 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-01a1c3c6-71b8-412a-814e-4cadfd26fb18 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1279 microversion: 2.1 time: 0.106037 May 26 15:11:24.214853 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 179/361] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:24 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:24.350790 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1f8fd35d-1399-4871-8031-8e163d6be407 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:24.351620 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1f8fd35d-1399-4871-8031-8e163d6be407 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:24.362749 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1f8fd35d-1399-4871-8031-8e163d6be407 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:24.363446 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1f8fd35d-1399-4871-8031-8e163d6be407 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.364219 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1f8fd35d-1399-4871-8031-8e163d6be407 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:24.364810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1f8fd35d-1399-4871-8031-8e163d6be407 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.518123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1f8fd35d-1399-4871-8031-8e163d6be407 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:24.523305 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:24.527129 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:24.536859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:24.537399 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.538358 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1f8fd35d-1399-4871-8031-8e163d6be407 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.191740 May 26 15:11:24.539669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 183/362] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:24 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:24.546203 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:24.546966 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:24.712797 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:24.726801 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:24.728587 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:24.729790 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0a1b118e-2506-430b-bdca-063cbc1c6996 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.210454 May 26 15:11:24.743347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 180/363] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:24 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:11:25.122252 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ea64362a-3812-4437-89bb-8ab939e08a8e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:25.123195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ea64362a-3812-4437-89bb-8ab939e08a8e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:25.131018 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ea64362a-3812-4437-89bb-8ab939e08a8e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.131551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ea64362a-3812-4437-89bb-8ab939e08a8e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.132463 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ea64362a-3812-4437-89bb-8ab939e08a8e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.133051 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ea64362a-3812-4437-89bb-8ab939e08a8e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.156340 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-025ab48f-974d-47b4-936c-a0ace7491e85 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:25.157027 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-025ab48f-974d-47b4-936c-a0ace7491e85 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:25.180983 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-025ab48f-974d-47b4-936c-a0ace7491e85 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.181438 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-025ab48f-974d-47b4-936c-a0ace7491e85 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.182261 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-025ab48f-974d-47b4-936c-a0ace7491e85 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.182909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-025ab48f-974d-47b4-936c-a0ace7491e85 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.605984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ea64362a-3812-4437-89bb-8ab939e08a8e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:25.616344 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ea64362a-3812-4437-89bb-8ab939e08a8e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.498611 May 26 15:11:25.617477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 184/364] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:25 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:25.631283 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8997c011-fa3e-42ee-becf-62950b655bf2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:25.636406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8997c011-fa3e-42ee-becf-62950b655bf2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:25.652247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8997c011-fa3e-42ee-becf-62950b655bf2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.655635 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8997c011-fa3e-42ee-becf-62950b655bf2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.658724 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8997c011-fa3e-42ee-becf-62950b655bf2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.661502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8997c011-fa3e-42ee-becf-62950b655bf2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.724745 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-025ab48f-974d-47b4-936c-a0ace7491e85 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:25.746324 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-025ab48f-974d-47b4-936c-a0ace7491e85 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.595525 May 26 15:11:25.747538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 181/365] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:25 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:25.752645 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-beacbb10-3430-49ff-b0c5-12c90660ebda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:25.753635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-beacbb10-3430-49ff-b0c5-12c90660ebda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:25.768380 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8997c011-fa3e-42ee-becf-62950b655bf2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:25.779063 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8997c011-fa3e-42ee-becf-62950b655bf2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1277 microversion: 2.1 time: 0.158384 May 26 15:11:25.780322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-beacbb10-3430-49ff-b0c5-12c90660ebda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.782233 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 185/366] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:25 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:25.782627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-beacbb10-3430-49ff-b0c5-12c90660ebda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.783708 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-beacbb10-3430-49ff-b0c5-12c90660ebda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.788776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:25.789723 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-beacbb10-3430-49ff-b0c5-12c90660ebda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.795176 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:25.810076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.810868 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:25.811841 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:25.812345 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:26.012754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-beacbb10-3430-49ff-b0c5-12c90660ebda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:26.026407 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-beacbb10-3430-49ff-b0c5-12c90660ebda tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.274968 May 26 15:11:26.027387 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 182/367] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:25 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:26.082542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:26.097579 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:26.106561 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:26.108014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-672911d3-5227-4195-8b06-4ea4c424c9cc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.323076 May 26 15:11:26.108670 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 186/368] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:25 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:26.635251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c9793fb3-2275-4ee2-b8d2-5ac46d03b776 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:26.635891 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c9793fb3-2275-4ee2-b8d2-5ac46d03b776 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:26.646453 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c9793fb3-2275-4ee2-b8d2-5ac46d03b776 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:26.647178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c9793fb3-2275-4ee2-b8d2-5ac46d03b776 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:26.649016 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c9793fb3-2275-4ee2-b8d2-5ac46d03b776 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:26.649785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c9793fb3-2275-4ee2-b8d2-5ac46d03b776 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:26.764056 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a12dba72-3d55-448d-ae06-09b8a2f0a2db tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:26.764671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a12dba72-3d55-448d-ae06-09b8a2f0a2db tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:26.780945 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a12dba72-3d55-448d-ae06-09b8a2f0a2db tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:26.781770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a12dba72-3d55-448d-ae06-09b8a2f0a2db tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:26.782760 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a12dba72-3d55-448d-ae06-09b8a2f0a2db tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:26.783504 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a12dba72-3d55-448d-ae06-09b8a2f0a2db tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:26.930815 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c9793fb3-2275-4ee2-b8d2-5ac46d03b776 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:26.939770 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c9793fb3-2275-4ee2-b8d2-5ac46d03b776 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.309118 May 26 15:11:26.940348 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 183/369] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:26 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:26.945425 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3d6588c2-ff93-4219-8814-8665bb72f8ef tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:26.946221 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3d6588c2-ff93-4219-8814-8665bb72f8ef tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:26.953193 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3d6588c2-ff93-4219-8814-8665bb72f8ef tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:26.953684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3d6588c2-ff93-4219-8814-8665bb72f8ef tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:26.954456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3d6588c2-ff93-4219-8814-8665bb72f8ef tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:26.954923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3d6588c2-ff93-4219-8814-8665bb72f8ef tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:27.010907 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a12dba72-3d55-448d-ae06-09b8a2f0a2db tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:27.019000 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a12dba72-3d55-448d-ae06-09b8a2f0a2db tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.258816 May 26 15:11:27.019572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 187/370] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:26 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:27.026993 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3d6588c2-ff93-4219-8814-8665bb72f8ef tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:27.029363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:27.039302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3d6588c2-ff93-4219-8814-8665bb72f8ef tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1277 microversion: 2.1 time: 0.095692 May 26 15:11:27.039302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 184/371] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:26 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:27.044600 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4fcad0d1-89a6-45be-a035-aa3442bde124 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:27.045218 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4fcad0d1-89a6-45be-a035-aa3442bde124 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:27.053071 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4fcad0d1-89a6-45be-a035-aa3442bde124 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:27.054052 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4fcad0d1-89a6-45be-a035-aa3442bde124 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:27.055677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4fcad0d1-89a6-45be-a035-aa3442bde124 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:27.056334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4fcad0d1-89a6-45be-a035-aa3442bde124 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:27.132358 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:27.133049 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:27.139520 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:27.139977 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:27.140744 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:27.141178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:27.262585 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4fcad0d1-89a6-45be-a035-aa3442bde124 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:27.276404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4fcad0d1-89a6-45be-a035-aa3442bde124 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.235645 May 26 15:11:27.277542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 188/372] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:27 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:27.309058 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:27.320993 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:27.322655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:27.324014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5ca3c8b1-1d9b-4afe-8d50-f2a97729b10d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.195879 May 26 15:11:27.324675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 185/373] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:27 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:27.802616 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-1a8a15d9-071e-4f74-82b9-9476b140414c req-41ac5ced-208f-4748-aaca-d54f44139a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f", "name": "network-vif-plugged", "status": "completed", "tag": "2b9adcd0-48a4-4233-a3fb-694dc9e1657f"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:27.813839 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-1a8a15d9-071e-4f74-82b9-9476b140414c req-41ac5ced-208f-4748-aaca-d54f44139a2d service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:27.814290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-1a8a15d9-071e-4f74-82b9-9476b140414c req-41ac5ced-208f-4748-aaca-d54f44139a2d service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:27.842021 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-1a8a15d9-071e-4f74-82b9-9476b140414c req-41ac5ced-208f-4748-aaca-d54f44139a2d service nova] Creating event network-vif-plugged:2b9adcd0-48a4-4233-a3fb-694dc9e1657f for instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f on hv-cinder-78836 May 26 15:11:27.857432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-1a8a15d9-071e-4f74-82b9-9476b140414c req-41ac5ced-208f-4748-aaca-d54f44139a2d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057981 May 26 15:11:27.862720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 189/374] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:27.956070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-80bba41b-8962-4847-91c6-efcf49824927 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:27.956678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-80bba41b-8962-4847-91c6-efcf49824927 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:27.964209 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-80bba41b-8962-4847-91c6-efcf49824927 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:27.964936 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-80bba41b-8962-4847-91c6-efcf49824927 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:27.965923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-80bba41b-8962-4847-91c6-efcf49824927 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:27.966514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-80bba41b-8962-4847-91c6-efcf49824927 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.037025 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c7fef964-8938-4b33-b4ae-2d05d7fdd1ed tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:28.037769 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c7fef964-8938-4b33-b4ae-2d05d7fdd1ed tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:28.048578 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7fef964-8938-4b33-b4ae-2d05d7fdd1ed tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.055408 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7fef964-8938-4b33-b4ae-2d05d7fdd1ed tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.056253 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7fef964-8938-4b33-b4ae-2d05d7fdd1ed tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.056710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7fef964-8938-4b33-b4ae-2d05d7fdd1ed tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.191431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-80bba41b-8962-4847-91c6-efcf49824927 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:28.201013 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-80bba41b-8962-4847-91c6-efcf49824927 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.248577 May 26 15:11:28.202141 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 186/375] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:27 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:28.206812 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e7b6b48b-4af8-439e-bf2a-7a85683ec039 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:28.207623 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e7b6b48b-4af8-439e-bf2a-7a85683ec039 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:28.214024 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e7b6b48b-4af8-439e-bf2a-7a85683ec039 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.214680 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e7b6b48b-4af8-439e-bf2a-7a85683ec039 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.215481 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e7b6b48b-4af8-439e-bf2a-7a85683ec039 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.215910 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e7b6b48b-4af8-439e-bf2a-7a85683ec039 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.270655 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c7fef964-8938-4b33-b4ae-2d05d7fdd1ed tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:28.289154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c7fef964-8938-4b33-b4ae-2d05d7fdd1ed tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.256019 May 26 15:11:28.290734 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 190/376] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:28 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:28.295656 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7900a165-a6e5-4064-a369-6b7102369980 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:28.296567 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7900a165-a6e5-4064-a369-6b7102369980 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:28.303616 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7900a165-a6e5-4064-a369-6b7102369980 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.304549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7900a165-a6e5-4064-a369-6b7102369980 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.305436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7900a165-a6e5-4064-a369-6b7102369980 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.306079 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7900a165-a6e5-4064-a369-6b7102369980 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.335472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e7b6b48b-4af8-439e-bf2a-7a85683ec039 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:28.355481 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e7b6b48b-4af8-439e-bf2a-7a85683ec039 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1277 microversion: 2.1 time: 0.151978 May 26 15:11:28.356106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 187/377] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:28 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:28.365085 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:28.365085 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:28.368509 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.368968 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.369779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:28.370227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:28.526621 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7900a165-a6e5-4064-a369-6b7102369980 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:28.547900 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7900a165-a6e5-4064-a369-6b7102369980 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.250549 May 26 15:11:28.548867 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 191/378] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:28 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:28.599917 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:28.609737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:28.611533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:28.612858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-744d3003-154f-4464-9d46-03c1b49262d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.255684 May 26 15:11:28.613696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 188/379] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:28 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:29.218748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-59994b1c-b21f-463d-974c-604e5cf48c02 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:29.219153 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-59994b1c-b21f-463d-974c-604e5cf48c02 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:29.226219 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-59994b1c-b21f-463d-974c-604e5cf48c02 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.226671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-59994b1c-b21f-463d-974c-604e5cf48c02 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.227443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-59994b1c-b21f-463d-974c-604e5cf48c02 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.227878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-59994b1c-b21f-463d-974c-604e5cf48c02 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.232423 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:29.308865 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-16ee5db2-820f-435e-b801-88f780a0c89c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:29.310246 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-16ee5db2-820f-435e-b801-88f780a0c89c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:29.325530 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-16ee5db2-820f-435e-b801-88f780a0c89c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.326231 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-16ee5db2-820f-435e-b801-88f780a0c89c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.327181 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-16ee5db2-820f-435e-b801-88f780a0c89c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.327765 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-16ee5db2-820f-435e-b801-88f780a0c89c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.396192 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-59994b1c-b21f-463d-974c-604e5cf48c02 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:29.410050 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-59994b1c-b21f-463d-974c-604e5cf48c02 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.195324 May 26 15:11:29.410741 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 192/380] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:29 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:29.415733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-96020aab-e4d3-4f49-b2d4-de57d5495ce4 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:29.416580 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-96020aab-e4d3-4f49-b2d4-de57d5495ce4 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:29.423327 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-96020aab-e4d3-4f49-b2d4-de57d5495ce4 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.423876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-96020aab-e4d3-4f49-b2d4-de57d5495ce4 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.424707 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-96020aab-e4d3-4f49-b2d4-de57d5495ce4 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.425205 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-96020aab-e4d3-4f49-b2d4-de57d5495ce4 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.518146 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-96020aab-e4d3-4f49-b2d4-de57d5495ce4 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:29.528464 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-96020aab-e4d3-4f49-b2d4-de57d5495ce4 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1277 microversion: 2.1 time: 0.115600 May 26 15:11:29.529174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 193/381] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:29 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:29.540244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-16ee5db2-820f-435e-b801-88f780a0c89c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:29.548488 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-16ee5db2-820f-435e-b801-88f780a0c89c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.245801 May 26 15:11:29.549035 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 189/382] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:29 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:29.566617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-993c5ddb-c25e-4298-a55e-f534ca11b90a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:29.567222 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-993c5ddb-c25e-4298-a55e-f534ca11b90a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:29.574240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-993c5ddb-c25e-4298-a55e-f534ca11b90a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.575820 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-993c5ddb-c25e-4298-a55e-f534ca11b90a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.576600 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-993c5ddb-c25e-4298-a55e-f534ca11b90a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.577322 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-993c5ddb-c25e-4298-a55e-f534ca11b90a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.635589 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:29.636209 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:29.645694 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.646458 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.647447 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:29.648094 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:29.818507 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-993c5ddb-c25e-4298-a55e-f534ca11b90a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:29.826979 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-993c5ddb-c25e-4298-a55e-f534ca11b90a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.265129 May 26 15:11:29.837853 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 194/383] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:29 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:29.842356 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:29.856585 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:29.856585 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:29.856585 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e5aff119-a226-4ce8-9f1e-85deeda80e33 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.223892 May 26 15:11:29.856991 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 190/384] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:29 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:30.427257 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0acfc68a-bdb0-4779-9e65-f60a00c5dc2d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:30.428552 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0acfc68a-bdb0-4779-9e65-f60a00c5dc2d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:30.437909 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0acfc68a-bdb0-4779-9e65-f60a00c5dc2d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.438649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0acfc68a-bdb0-4779-9e65-f60a00c5dc2d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.439828 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0acfc68a-bdb0-4779-9e65-f60a00c5dc2d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.440508 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0acfc68a-bdb0-4779-9e65-f60a00c5dc2d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.545861 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-18baf60f-775f-4e9a-bd28-59fa5a1060ab tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:30.547134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-18baf60f-775f-4e9a-bd28-59fa5a1060ab tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:30.562510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18baf60f-775f-4e9a-bd28-59fa5a1060ab tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.566712 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18baf60f-775f-4e9a-bd28-59fa5a1060ab tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.567814 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18baf60f-775f-4e9a-bd28-59fa5a1060ab tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.568230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-18baf60f-775f-4e9a-bd28-59fa5a1060ab tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.703981 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-18baf60f-775f-4e9a-bd28-59fa5a1060ab tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:30.717171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-18baf60f-775f-4e9a-bd28-59fa5a1060ab tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1277 microversion: 2.1 time: 0.174610 May 26 15:11:30.718036 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 191/385] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:30 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:30.727287 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0acfc68a-bdb0-4779-9e65-f60a00c5dc2d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:30.731445 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0acfc68a-bdb0-4779-9e65-f60a00c5dc2d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.308078 May 26 15:11:30.731602 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-58b36dd3-3f69-4aba-8586-2bf038ad2499 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:30.732140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-58b36dd3-3f69-4aba-8586-2bf038ad2499 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:30.732956 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 195/386] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:30 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:30.739254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58b36dd3-3f69-4aba-8586-2bf038ad2499 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.739783 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58b36dd3-3f69-4aba-8586-2bf038ad2499 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.740636 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58b36dd3-3f69-4aba-8586-2bf038ad2499 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.741143 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-58b36dd3-3f69-4aba-8586-2bf038ad2499 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.845677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-22f1d9f8-5b8f-43ef-adfa-f66eafdc08e2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:30.846728 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-22f1d9f8-5b8f-43ef-adfa-f66eafdc08e2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:30.853909 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-22f1d9f8-5b8f-43ef-adfa-f66eafdc08e2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.854706 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-22f1d9f8-5b8f-43ef-adfa-f66eafdc08e2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:30.855714 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-22f1d9f8-5b8f-43ef-adfa-f66eafdc08e2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:30.856374 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-22f1d9f8-5b8f-43ef-adfa-f66eafdc08e2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.026969 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-58b36dd3-3f69-4aba-8586-2bf038ad2499 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:31.044475 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-58b36dd3-3f69-4aba-8586-2bf038ad2499 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.325264 May 26 15:11:31.057589 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 192/387] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:30 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:31.064482 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:31.086007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:31.086007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:31.086007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:31.086007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.086699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:31.086699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.236028 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-22f1d9f8-5b8f-43ef-adfa-f66eafdc08e2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:31.244538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-22f1d9f8-5b8f-43ef-adfa-f66eafdc08e2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.404426 May 26 15:11:31.245154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 196/388] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:30 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:31.308452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:31.317692 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:31.319244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:31.321175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6bb67460-cc2b-41ab-8bcb-575b956294bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.262747 May 26 15:11:31.322016 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 193/389] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:31 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:31.738682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6b41c699-1a37-42d7-bcfd-a9d02b408ba9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:31.739720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6b41c699-1a37-42d7-bcfd-a9d02b408ba9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:31.747967 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6b41c699-1a37-42d7-bcfd-a9d02b408ba9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:31.748848 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6b41c699-1a37-42d7-bcfd-a9d02b408ba9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.749152 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8c324698-e3aa-4cae-a830-fa7bcad6cea8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:31.749844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8c324698-e3aa-4cae-a830-fa7bcad6cea8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:31.750668 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6b41c699-1a37-42d7-bcfd-a9d02b408ba9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:31.751322 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6b41c699-1a37-42d7-bcfd-a9d02b408ba9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.767825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c324698-e3aa-4cae-a830-fa7bcad6cea8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:31.769591 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c324698-e3aa-4cae-a830-fa7bcad6cea8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.770676 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c324698-e3aa-4cae-a830-fa7bcad6cea8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:31.771319 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c324698-e3aa-4cae-a830-fa7bcad6cea8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:31.831922 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6b41c699-1a37-42d7-bcfd-a9d02b408ba9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:31.839740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6b41c699-1a37-42d7-bcfd-a9d02b408ba9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1277 microversion: 2.1 time: 0.108243 May 26 15:11:31.846162 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 197/390] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:31 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:31.989662 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8c324698-e3aa-4cae-a830-fa7bcad6cea8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:31.998830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8c324698-e3aa-4cae-a830-fa7bcad6cea8 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.253994 May 26 15:11:32.013642 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 194/391] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:31 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:32.063170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-229de80d-f856-4627-8bcd-2c64984b2a70 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:32.063797 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-229de80d-f856-4627-8bcd-2c64984b2a70 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:32.070750 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-229de80d-f856-4627-8bcd-2c64984b2a70 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:32.071944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-229de80d-f856-4627-8bcd-2c64984b2a70 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:32.073200 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-229de80d-f856-4627-8bcd-2c64984b2a70 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:32.073818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-229de80d-f856-4627-8bcd-2c64984b2a70 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:32.251480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-229de80d-f856-4627-8bcd-2c64984b2a70 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:32.260575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-229de80d-f856-4627-8bcd-2c64984b2a70 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.201557 May 26 15:11:32.262034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9807ee4d-e27b-4b6f-9a11-37a4e751ca72 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:32.262547 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 198/392] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:32 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:32.272794 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9807ee4d-e27b-4b6f-9a11-37a4e751ca72 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:32.278651 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=4 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:32.279973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=16 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:32.282218 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9807ee4d-e27b-4b6f-9a11-37a4e751ca72 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:32.282938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9807ee4d-e27b-4b6f-9a11-37a4e751ca72 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:32.284240 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9807ee4d-e27b-4b6f-9a11-37a4e751ca72 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:32.284928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9807ee4d-e27b-4b6f-9a11-37a4e751ca72 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:32.341394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:32.342956 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:32.349694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:32.350447 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:32.352188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:32.352844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:32.492808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9807ee4d-e27b-4b6f-9a11-37a4e751ca72 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:32.504874 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9807ee4d-e27b-4b6f-9a11-37a4e751ca72 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.246946 May 26 15:11:32.505667 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 195/393] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:32 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:32.553321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:32.570203 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:32.571730 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:32.572906 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-92f20ddf-7ddb-46d4-bf82-3e7093751eb8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.235389 May 26 15:11:32.573785 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 199/394] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:32 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:11:32.873173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a4f8039e-8f9f-4aec-8295-10fb6deb8e9c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:32.873907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a4f8039e-8f9f-4aec-8295-10fb6deb8e9c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:32.880443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4f8039e-8f9f-4aec-8295-10fb6deb8e9c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:32.881106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4f8039e-8f9f-4aec-8295-10fb6deb8e9c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:32.882120 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4f8039e-8f9f-4aec-8295-10fb6deb8e9c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:32.882896 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4f8039e-8f9f-4aec-8295-10fb6deb8e9c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.013668 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a4f8039e-8f9f-4aec-8295-10fb6deb8e9c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:33.020040 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6e18f818-94b3-4d4c-bc71-dd430dd16783 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:33.020663 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6e18f818-94b3-4d4c-bc71-dd430dd16783 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:33.023800 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=4 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:33.032768 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a4f8039e-8f9f-4aec-8295-10fb6deb8e9c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1277 microversion: 2.1 time: 0.163816 May 26 15:11:33.045292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 196/395] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:32 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:33.048963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6e18f818-94b3-4d4c-bc71-dd430dd16783 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.049431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6e18f818-94b3-4d4c-bc71-dd430dd16783 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.050241 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6e18f818-94b3-4d4c-bc71-dd430dd16783 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.055626 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6e18f818-94b3-4d4c-bc71-dd430dd16783 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.231871 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6e18f818-94b3-4d4c-bc71-dd430dd16783 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:33.239551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6e18f818-94b3-4d4c-bc71-dd430dd16783 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.223778 May 26 15:11:33.240394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 200/396] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:33 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:33.280092 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0effd0c4-6acd-40a5-bc67-d31efe79fa06 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:33.280696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0effd0c4-6acd-40a5-bc67-d31efe79fa06 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:33.287800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0effd0c4-6acd-40a5-bc67-d31efe79fa06 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.287800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0effd0c4-6acd-40a5-bc67-d31efe79fa06 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.289050 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0effd0c4-6acd-40a5-bc67-d31efe79fa06 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.290183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0effd0c4-6acd-40a5-bc67-d31efe79fa06 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.486025 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0effd0c4-6acd-40a5-bc67-d31efe79fa06 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:33.500070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0effd0c4-6acd-40a5-bc67-d31efe79fa06 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.223829 May 26 15:11:33.501189 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 197/397] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:33 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:33.528899 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d71d24b9-dcd8-4b2e-b988-8aacd2cd4e52 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:33.530600 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d71d24b9-dcd8-4b2e-b988-8aacd2cd4e52 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:33.541272 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d71d24b9-dcd8-4b2e-b988-8aacd2cd4e52 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.542284 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d71d24b9-dcd8-4b2e-b988-8aacd2cd4e52 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.543720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d71d24b9-dcd8-4b2e-b988-8aacd2cd4e52 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.544796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d71d24b9-dcd8-4b2e-b988-8aacd2cd4e52 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.591529 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:33.592285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:33.599168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.599729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.600460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:33.600920 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:33.807389 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d71d24b9-dcd8-4b2e-b988-8aacd2cd4e52 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:33.815181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d71d24b9-dcd8-4b2e-b988-8aacd2cd4e52 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.296004 May 26 15:11:33.815754 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 201/398] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:33 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:33.822479 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:33.831522 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:33.833044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:33.834237 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7fb77153-0da5-44ec-a84f-d50034629ad0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.246666 May 26 15:11:33.835855 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 198/399] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:33 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:34.050890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9521afbd-3a91-454c-be4e-d93a108a48b6 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:34.051532 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9521afbd-3a91-454c-be4e-d93a108a48b6 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:34.058681 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9521afbd-3a91-454c-be4e-d93a108a48b6 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.059132 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9521afbd-3a91-454c-be4e-d93a108a48b6 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.060077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9521afbd-3a91-454c-be4e-d93a108a48b6 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.060542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9521afbd-3a91-454c-be4e-d93a108a48b6 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.121844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9521afbd-3a91-454c-be4e-d93a108a48b6 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:34.129386 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9521afbd-3a91-454c-be4e-d93a108a48b6 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1277 microversion: 2.1 time: 0.082672 May 26 15:11:34.129972 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 202/400] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:34 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:34.259326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0f248891-5992-4555-ab9d-ed3bff91d150 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:34.259921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0f248891-5992-4555-ab9d-ed3bff91d150 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:34.267083 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f248891-5992-4555-ab9d-ed3bff91d150 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.267535 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f248891-5992-4555-ab9d-ed3bff91d150 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.268363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f248891-5992-4555-ab9d-ed3bff91d150 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.268919 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0f248891-5992-4555-ab9d-ed3bff91d150 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.406140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0f248891-5992-4555-ab9d-ed3bff91d150 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:34.413927 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0f248891-5992-4555-ab9d-ed3bff91d150 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.159197 May 26 15:11:34.414487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 199/401] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:34 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:34.531285 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9cbf1642-9108-4ff3-b7bf-ece211912b1e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:34.532213 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9cbf1642-9108-4ff3-b7bf-ece211912b1e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:34.539554 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9cbf1642-9108-4ff3-b7bf-ece211912b1e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.540231 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9cbf1642-9108-4ff3-b7bf-ece211912b1e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.541242 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9cbf1642-9108-4ff3-b7bf-ece211912b1e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.541762 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9cbf1642-9108-4ff3-b7bf-ece211912b1e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.685651 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9cbf1642-9108-4ff3-b7bf-ece211912b1e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:34.695848 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9cbf1642-9108-4ff3-b7bf-ece211912b1e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1723 microversion: 2.1 time: 0.169940 May 26 15:11:34.696457 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 203/402] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:34 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:34.833488 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ba279578-7bd1-4b1b-8f64-8c5f7df1d95e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:34.834019 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ba279578-7bd1-4b1b-8f64-8c5f7df1d95e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:34.840641 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ba279578-7bd1-4b1b-8f64-8c5f7df1d95e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.841147 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ba279578-7bd1-4b1b-8f64-8c5f7df1d95e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.841964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ba279578-7bd1-4b1b-8f64-8c5f7df1d95e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.842390 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ba279578-7bd1-4b1b-8f64-8c5f7df1d95e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.853865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:34.854476 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:34.861736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.862286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:34.863229 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:34.863663 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:35.049127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ba279578-7bd1-4b1b-8f64-8c5f7df1d95e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:35.057972 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ba279578-7bd1-4b1b-8f64-8c5f7df1d95e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.228342 May 26 15:11:35.058701 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 200/403] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:34 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:35.063877 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:35.072210 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:35.073858 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:35.075006 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a3a71e35-1477-4f37-a52a-3ac955d03680 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.225771 May 26 15:11:35.075547 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 204/404] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:34 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:11:35.145872 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ee7c601d-71d7-41cc-9b6c-3c79f32aa34e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:35.146411 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ee7c601d-71d7-41cc-9b6c-3c79f32aa34e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:35.152420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ee7c601d-71d7-41cc-9b6c-3c79f32aa34e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:35.152873 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ee7c601d-71d7-41cc-9b6c-3c79f32aa34e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:35.153673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ee7c601d-71d7-41cc-9b6c-3c79f32aa34e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:35.154112 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ee7c601d-71d7-41cc-9b6c-3c79f32aa34e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:35.169422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:35.284798 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ee7c601d-71d7-41cc-9b6c-3c79f32aa34e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:35.292707 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ee7c601d-71d7-41cc-9b6c-3c79f32aa34e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.150735 May 26 15:11:35.293283 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 201/405] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:35 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:35.430004 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a9160a4a-5d20-4232-9d33-834973eb26e4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:35.430556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a9160a4a-5d20-4232-9d33-834973eb26e4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:35.436580 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a9160a4a-5d20-4232-9d33-834973eb26e4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:35.437025 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a9160a4a-5d20-4232-9d33-834973eb26e4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:35.437795 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a9160a4a-5d20-4232-9d33-834973eb26e4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:35.438228 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a9160a4a-5d20-4232-9d33-834973eb26e4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:35.565592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a9160a4a-5d20-4232-9d33-834973eb26e4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:35.573161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a9160a4a-5d20-4232-9d33-834973eb26e4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.147142 May 26 15:11:35.573700 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 205/406] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:35 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:35.714081 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7bdac678-ef4e-40d9-b27a-f985352fe517 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:35.714605 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7bdac678-ef4e-40d9-b27a-f985352fe517 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:35.720629 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7bdac678-ef4e-40d9-b27a-f985352fe517 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:35.721070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7bdac678-ef4e-40d9-b27a-f985352fe517 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:35.721844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7bdac678-ef4e-40d9-b27a-f985352fe517 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:35.722276 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7bdac678-ef4e-40d9-b27a-f985352fe517 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:35.850450 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7bdac678-ef4e-40d9-b27a-f985352fe517 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:35.858369 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7bdac678-ef4e-40d9-b27a-f985352fe517 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1700 microversion: 2.1 time: 0.148851 May 26 15:11:35.858953 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 202/407] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:35 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1700 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:35.875020 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-89c81d1d-a2c5-4b99-a2fa-c9961443aef1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:35.881109 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-89c81d1d-a2c5-4b99-a2fa-c9961443aef1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:35.881589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-89c81d1d-a2c5-4b99-a2fa-c9961443aef1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:35.942399 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-89c81d1d-a2c5-4b99-a2fa-c9961443aef1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Going to try to start instance {{(pid=117724) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 15:11:35.984494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-89c81d1d-a2c5-4b99-a2fa-c9961443aef1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/action" status: 202 len: 0 microversion: 2.1 time: 0.113251 May 26 15:11:35.985008 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 206/408] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:11:35 2022] POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:11:35.993070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-104206fc-f738-4088-8c63-adf9289f9a3a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:35.993713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-104206fc-f738-4088-8c63-adf9289f9a3a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:36.000833 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-104206fc-f738-4088-8c63-adf9289f9a3a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.001284 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-104206fc-f738-4088-8c63-adf9289f9a3a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.002068 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-104206fc-f738-4088-8c63-adf9289f9a3a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.002508 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-104206fc-f738-4088-8c63-adf9289f9a3a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.076592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-53bb0b6d-84bc-4688-a95f-e651359e2f21 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:36.077296 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-53bb0b6d-84bc-4688-a95f-e651359e2f21 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:36.083570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53bb0b6d-84bc-4688-a95f-e651359e2f21 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.084043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53bb0b6d-84bc-4688-a95f-e651359e2f21 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.084810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53bb0b6d-84bc-4688-a95f-e651359e2f21 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.085250 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-53bb0b6d-84bc-4688-a95f-e651359e2f21 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.145307 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-104206fc-f738-4088-8c63-adf9289f9a3a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:36.153253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-104206fc-f738-4088-8c63-adf9289f9a3a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1709 microversion: 2.1 time: 0.164040 May 26 15:11:36.153844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 203/409] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:35 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:36.158409 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:36.159035 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:36.166207 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.166655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.167597 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.168029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.276743 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-53bb0b6d-84bc-4688-a95f-e651359e2f21 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:36.280406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:36.285853 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-53bb0b6d-84bc-4688-a95f-e651359e2f21 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.214017 May 26 15:11:36.286438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 207/410] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:36 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:36.309879 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5f1f4245-b8d6-4df1-9b2b-dea8eb3fffac tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:36.310515 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5f1f4245-b8d6-4df1-9b2b-dea8eb3fffac tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:36.317726 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f1f4245-b8d6-4df1-9b2b-dea8eb3fffac tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.318172 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f1f4245-b8d6-4df1-9b2b-dea8eb3fffac tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.318959 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f1f4245-b8d6-4df1-9b2b-dea8eb3fffac tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.319391 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f1f4245-b8d6-4df1-9b2b-dea8eb3fffac tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.333617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:36.342500 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:36.344433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:36.345315 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-050f5b22-a068-4412-a65c-46e4582825e9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.190493 May 26 15:11:36.352958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 204/411] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:36 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:36.450369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5f1f4245-b8d6-4df1-9b2b-dea8eb3fffac tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:36.457716 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5f1f4245-b8d6-4df1-9b2b-dea8eb3fffac tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.151648 May 26 15:11:36.458281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 208/412] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:36 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:36.590937 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5add99a5-f2fd-49ea-a4f3-e84b54516070 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:36.591542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5add99a5-f2fd-49ea-a4f3-e84b54516070 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:36.597482 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5add99a5-f2fd-49ea-a4f3-e84b54516070 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.597934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5add99a5-f2fd-49ea-a4f3-e84b54516070 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.598681 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5add99a5-f2fd-49ea-a4f3-e84b54516070 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:36.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5add99a5-f2fd-49ea-a4f3-e84b54516070 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:36.730529 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5add99a5-f2fd-49ea-a4f3-e84b54516070 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:36.737885 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5add99a5-f2fd-49ea-a4f3-e84b54516070 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.151550 May 26 15:11:36.738431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 205/413] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:36 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:37.170659 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a2f2d515-9a53-4da5-9757-168378ce54fb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:37.171276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a2f2d515-9a53-4da5-9757-168378ce54fb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:37.177806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a2f2d515-9a53-4da5-9757-168378ce54fb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.178261 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a2f2d515-9a53-4da5-9757-168378ce54fb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.179019 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a2f2d515-9a53-4da5-9757-168378ce54fb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.179466 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a2f2d515-9a53-4da5-9757-168378ce54fb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.304685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ff6d9ff3-12c6-4fc3-883f-ba84b4959111 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:37.306318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ff6d9ff3-12c6-4fc3-883f-ba84b4959111 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:37.321352 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ff6d9ff3-12c6-4fc3-883f-ba84b4959111 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.321998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ff6d9ff3-12c6-4fc3-883f-ba84b4959111 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.322893 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ff6d9ff3-12c6-4fc3-883f-ba84b4959111 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.323182 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ff6d9ff3-12c6-4fc3-883f-ba84b4959111 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.419774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a2f2d515-9a53-4da5-9757-168378ce54fb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:37.434648 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a2f2d515-9a53-4da5-9757-168378ce54fb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1709 microversion: 2.1 time: 0.267135 May 26 15:11:37.445025 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 209/414] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:37 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1709 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:37.445025 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:37.445025 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:37.457149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.457671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.458451 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.458892 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.576834 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ff6d9ff3-12c6-4fc3-883f-ba84b4959111 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:37.584596 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ff6d9ff3-12c6-4fc3-883f-ba84b4959111 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.284753 May 26 15:11:37.594261 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 206/415] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:37 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:37.594261 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-92112fbf-a34a-4b33-959b-84ed9c158274 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:37.594261 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-92112fbf-a34a-4b33-959b-84ed9c158274 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:37.598861 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92112fbf-a34a-4b33-959b-84ed9c158274 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.599308 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92112fbf-a34a-4b33-959b-84ed9c158274 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.600084 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92112fbf-a34a-4b33-959b-84ed9c158274 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.600685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-92112fbf-a34a-4b33-959b-84ed9c158274 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.661764 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:37.673243 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:37.674499 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:37.676435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-208470a8-e3fd-4e95-b165-752c42bc78d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.238169 May 26 15:11:37.677066 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 210/416] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:37 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:37.756158 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-045e99e7-0158-41d5-9763-45b065043953 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:37.756782 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-045e99e7-0158-41d5-9763-45b065043953 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:37.761987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-92112fbf-a34a-4b33-959b-84ed9c158274 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:37.763240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-045e99e7-0158-41d5-9763-45b065043953 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.763696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-045e99e7-0158-41d5-9763-45b065043953 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.764371 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-045e99e7-0158-41d5-9763-45b065043953 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:37.764815 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-045e99e7-0158-41d5-9763-45b065043953 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:37.769859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-92112fbf-a34a-4b33-959b-84ed9c158274 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.182670 May 26 15:11:37.770601 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 207/417] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:37 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:38.002169 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-934c21cf-ce3a-4855-a370-9051d7e367e5 req-3c390fba-01f9-42b0-9100-1b819e9a269e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60f535d-631c-4b12-97b0-d134f2042e1f", "tag": "930ee718-30cf-4a82-92d1-09e4d1723a9e"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:38.013728 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-934c21cf-ce3a-4855-a370-9051d7e367e5 req-3c390fba-01f9-42b0-9100-1b819e9a269e service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.014318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-934c21cf-ce3a-4855-a370-9051d7e367e5 req-3c390fba-01f9-42b0-9100-1b819e9a269e service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.027475 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-934c21cf-ce3a-4855-a370-9051d7e367e5 req-3c390fba-01f9-42b0-9100-1b819e9a269e service nova] Creating event network-changed:930ee718-30cf-4a82-92d1-09e4d1723a9e for instance d60f535d-631c-4b12-97b0-d134f2042e1f on hv-cinder-78836 May 26 15:11:38.032468 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-934c21cf-ce3a-4855-a370-9051d7e367e5 req-3c390fba-01f9-42b0-9100-1b819e9a269e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036067 May 26 15:11:38.033063 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 208/418] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:11:38.327985 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-045e99e7-0158-41d5-9763-45b065043953 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:38.335462 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-045e99e7-0158-41d5-9763-45b065043953 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.583132 May 26 15:11:38.336108 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 211/419] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:37 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:38.453829 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-32df7f52-57ee-435f-b5fa-1065de72ef43 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:38.454520 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-32df7f52-57ee-435f-b5fa-1065de72ef43 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:38.460655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32df7f52-57ee-435f-b5fa-1065de72ef43 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.461124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32df7f52-57ee-435f-b5fa-1065de72ef43 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.461906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32df7f52-57ee-435f-b5fa-1065de72ef43 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.462339 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32df7f52-57ee-435f-b5fa-1065de72ef43 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.594058 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-32df7f52-57ee-435f-b5fa-1065de72ef43 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:38.601419 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9147d90d-b371-4036-90a6-6a1d629d7ddc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:38.602023 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9147d90d-b371-4036-90a6-6a1d629d7ddc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:38.610435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9147d90d-b371-4036-90a6-6a1d629d7ddc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.610893 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9147d90d-b371-4036-90a6-6a1d629d7ddc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.611677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9147d90d-b371-4036-90a6-6a1d629d7ddc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.612112 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9147d90d-b371-4036-90a6-6a1d629d7ddc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.612559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-32df7f52-57ee-435f-b5fa-1065de72ef43 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1709 microversion: 2.1 time: 0.163509 May 26 15:11:38.627900 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 209/420] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:38 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:38.702288 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:38.703682 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:38.715258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.716069 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.717210 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.717840 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.797223 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9147d90d-b371-4036-90a6-6a1d629d7ddc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:38.805477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9147d90d-b371-4036-90a6-6a1d629d7ddc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1522 microversion: 2.1 time: 0.207160 May 26 15:11:38.806272 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 212/421] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:38 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:38.811107 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a4dc5326-d300-4094-a1fd-b57d32404b3a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:38.812127 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a4dc5326-d300-4094-a1fd-b57d32404b3a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:38.818219 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4dc5326-d300-4094-a1fd-b57d32404b3a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.818764 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4dc5326-d300-4094-a1fd-b57d32404b3a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.819605 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4dc5326-d300-4094-a1fd-b57d32404b3a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:38.820110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a4dc5326-d300-4094-a1fd-b57d32404b3a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:38.874930 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:38.883723 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:38.885632 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:38.886981 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-70cc4488-abf6-46df-bd20-6ceb7abf28ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.193614 May 26 15:11:38.887621 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 210/422] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:38 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:39.001872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a4dc5326-d300-4094-a1fd-b57d32404b3a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:39.009301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a4dc5326-d300-4094-a1fd-b57d32404b3a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.201984 May 26 15:11:39.010138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 213/423] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:38 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:39.354081 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1106495e-f274-475c-8466-694fbc062d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:39.356417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1106495e-f274-475c-8466-694fbc062d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:39.366671 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1106495e-f274-475c-8466-694fbc062d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.367255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1106495e-f274-475c-8466-694fbc062d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.368136 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1106495e-f274-475c-8466-694fbc062d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.368674 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1106495e-f274-475c-8466-694fbc062d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.502644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1106495e-f274-475c-8466-694fbc062d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:39.510657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1106495e-f274-475c-8466-694fbc062d48 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1366 microversion: 2.1 time: 0.162247 May 26 15:11:39.511147 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 211/424] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:39 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:39.631185 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b8519386-01c8-44f9-80f7-9f54a786e953 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:39.632070 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b8519386-01c8-44f9-80f7-9f54a786e953 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:39.640860 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b8519386-01c8-44f9-80f7-9f54a786e953 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.641337 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b8519386-01c8-44f9-80f7-9f54a786e953 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.642159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b8519386-01c8-44f9-80f7-9f54a786e953 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.642593 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b8519386-01c8-44f9-80f7-9f54a786e953 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.782793 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b8519386-01c8-44f9-80f7-9f54a786e953 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:39.790801 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b8519386-01c8-44f9-80f7-9f54a786e953 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1709 microversion: 2.1 time: 0.163789 May 26 15:11:39.791375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 214/425] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:39 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:39.823116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6d2fe637-3454-4f61-b6b3-a07129fdc1bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:39.823731 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6d2fe637-3454-4f61-b6b3-a07129fdc1bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:39.829670 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d2fe637-3454-4f61-b6b3-a07129fdc1bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.830124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d2fe637-3454-4f61-b6b3-a07129fdc1bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.830892 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d2fe637-3454-4f61-b6b3-a07129fdc1bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.831326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d2fe637-3454-4f61-b6b3-a07129fdc1bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.906543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:39.906909 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:39.913812 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.914356 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:39.915260 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:39.915803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.100909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6d2fe637-3454-4f61-b6b3-a07129fdc1bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:40.108968 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6d2fe637-3454-4f61-b6b3-a07129fdc1bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1502 microversion: 2.1 time: 0.290133 May 26 15:11:40.120909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 212/426] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:39 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1502 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:40.126444 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2d9f6f31-7edb-4210-a4d2-af660e8754cc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:40.127517 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2d9f6f31-7edb-4210-a4d2-af660e8754cc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:40.134992 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d9f6f31-7edb-4210-a4d2-af660e8754cc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.135401 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d9f6f31-7edb-4210-a4d2-af660e8754cc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.136262 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d9f6f31-7edb-4210-a4d2-af660e8754cc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.136866 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d9f6f31-7edb-4210-a4d2-af660e8754cc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.150801 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:40.160406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:40.163141 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:40.164957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-efd75de4-6c91-4f2b-a366-e01307ebd107 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.263642 May 26 15:11:40.165647 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 215/427] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:39 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:40.171200 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-13df55c4-9699-42e6-9a7b-0e0668fb5316 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:40.171963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-13df55c4-9699-42e6-9a7b-0e0668fb5316 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:40.178913 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13df55c4-9699-42e6-9a7b-0e0668fb5316 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.179477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13df55c4-9699-42e6-9a7b-0e0668fb5316 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.182434 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13df55c4-9699-42e6-9a7b-0e0668fb5316 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.182880 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13df55c4-9699-42e6-9a7b-0e0668fb5316 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.403416 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2d9f6f31-7edb-4210-a4d2-af660e8754cc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:40.411907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2d9f6f31-7edb-4210-a4d2-af660e8754cc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.289231 May 26 15:11:40.412682 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 213/428] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:40 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:40.433902 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-13df55c4-9699-42e6-9a7b-0e0668fb5316 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:40.441877 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-13df55c4-9699-42e6-9a7b-0e0668fb5316 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1516 microversion: 2.1 time: 0.274130 May 26 15:11:40.442344 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 216/429] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:40 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1516 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:40.531315 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-765c23b0-a49c-4a76-bbde-baf43081c039 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:40.532997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-765c23b0-a49c-4a76-bbde-baf43081c039 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:40.548428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-765c23b0-a49c-4a76-bbde-baf43081c039 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.549480 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-765c23b0-a49c-4a76-bbde-baf43081c039 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.550491 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-765c23b0-a49c-4a76-bbde-baf43081c039 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.551123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-765c23b0-a49c-4a76-bbde-baf43081c039 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.809379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-acf35d72-abfe-4c3e-9bbe-ab4ff4375157 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:40.811503 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-acf35d72-abfe-4c3e-9bbe-ab4ff4375157 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:40.825261 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-acf35d72-abfe-4c3e-9bbe-ab4ff4375157 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.825878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-acf35d72-abfe-4c3e-9bbe-ab4ff4375157 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.826785 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-acf35d72-abfe-4c3e-9bbe-ab4ff4375157 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.829933 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-acf35d72-abfe-4c3e-9bbe-ab4ff4375157 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.855615 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-765c23b0-a49c-4a76-bbde-baf43081c039 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:40.868935 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-765c23b0-a49c-4a76-bbde-baf43081c039 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1557 microversion: 2.1 time: 0.345281 May 26 15:11:40.869927 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 214/430] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:40 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1557 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:40.890790 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-69ea7ca5-8de3-4660-ad1d-746d3f77e651 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:40.891771 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-69ea7ca5-8de3-4660-ad1d-746d3f77e651 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:40.899896 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-69ea7ca5-8de3-4660-ad1d-746d3f77e651 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.900360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-69ea7ca5-8de3-4660-ad1d-746d3f77e651 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:40.901144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-69ea7ca5-8de3-4660-ad1d-746d3f77e651 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:40.917160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-69ea7ca5-8de3-4660-ad1d-746d3f77e651 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:41.094080 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-69ea7ca5-8de3-4660-ad1d-746d3f77e651 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.206608 May 26 15:11:41.096183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 215/431] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 15:11:40 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:41.134894 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-acf35d72-abfe-4c3e-9bbe-ab4ff4375157 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:41.143668 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-acf35d72-abfe-4c3e-9bbe-ab4ff4375157 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1709 microversion: 2.1 time: 0.339011 May 26 15:11:41.154561 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 217/432] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:40 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1709 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:41.184262 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:41.184805 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:41.190721 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:41.191168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:41.191924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:41.192360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:41.362713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:41.374994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:41.377232 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:41.378727 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-274930cd-249d-4a74-9b51-93dac63cce24 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.199003 May 26 15:11:41.379293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 216/433] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:41 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:41.429398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-510bbe7f-84d4-4303-9f6d-ae04243d9d81 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:41.430216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-510bbe7f-84d4-4303-9f6d-ae04243d9d81 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:41.437273 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-510bbe7f-84d4-4303-9f6d-ae04243d9d81 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:41.437951 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-510bbe7f-84d4-4303-9f6d-ae04243d9d81 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:41.438892 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-510bbe7f-84d4-4303-9f6d-ae04243d9d81 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:41.439334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-510bbe7f-84d4-4303-9f6d-ae04243d9d81 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:41.588280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-510bbe7f-84d4-4303-9f6d-ae04243d9d81 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:41.601252 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-510bbe7f-84d4-4303-9f6d-ae04243d9d81 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.175187 May 26 15:11:41.623477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 218/434] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:41 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:41.911802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b2ac1561-69b1-4f4d-ba66-fb167609e3c3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:41.912827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b2ac1561-69b1-4f4d-ba66-fb167609e3c3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:41.920100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2ac1561-69b1-4f4d-ba66-fb167609e3c3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:41.920554 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2ac1561-69b1-4f4d-ba66-fb167609e3c3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:41.921326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2ac1561-69b1-4f4d-ba66-fb167609e3c3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:41.921815 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2ac1561-69b1-4f4d-ba66-fb167609e3c3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:41.947045 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-b2ac1561-69b1-4f4d-ba66-fb167609e3c3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lazy-loading 'flavor' on Instance uuid ef06b3f7-244b-42fd-8657-59708a3b66f5 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:11:42.004275 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:42.036891 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b2ac1561-69b1-4f4d-ba66-fb167609e3c3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5/action" status: 200 len: 32 microversion: 2.1 time: 0.129099 May 26 15:11:42.037531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 217/435] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:11:41 2022] POST /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5/action => generated 32 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:11:42.047089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-743c4fa3-7ae4-4faf-8926-165efb42fc03 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:42.047705 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-743c4fa3-7ae4-4faf-8926-165efb42fc03 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:42.054294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-743c4fa3-7ae4-4faf-8926-165efb42fc03 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.054781 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-743c4fa3-7ae4-4faf-8926-165efb42fc03 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.055549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-743c4fa3-7ae4-4faf-8926-165efb42fc03 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.056162 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-743c4fa3-7ae4-4faf-8926-165efb42fc03 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.164108 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7d2e8e36-23ed-45cf-96dc-b20125d094ac tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:42.164970 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7d2e8e36-23ed-45cf-96dc-b20125d094ac tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:42.172304 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7d2e8e36-23ed-45cf-96dc-b20125d094ac tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.172943 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7d2e8e36-23ed-45cf-96dc-b20125d094ac tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.173849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7d2e8e36-23ed-45cf-96dc-b20125d094ac tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.174280 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7d2e8e36-23ed-45cf-96dc-b20125d094ac tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.352515 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-743c4fa3-7ae4-4faf-8926-165efb42fc03 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:42.360480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-743c4fa3-7ae4-4faf-8926-165efb42fc03 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.317098 May 26 15:11:42.361601 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 219/436] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:42 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:42.366448 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-a3118798-1a7b-4e35-9653-78e2338fa11d req-3e27ea32-d1a2-46b0-9ee1-ff2ff1485d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f", "tag": "2b9adcd0-48a4-4233-a3fb-694dc9e1657f"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:42.374911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-a3118798-1a7b-4e35-9653-78e2338fa11d req-3e27ea32-d1a2-46b0-9ee1-ff2ff1485d88 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.375354 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-a3118798-1a7b-4e35-9653-78e2338fa11d req-3e27ea32-d1a2-46b0-9ee1-ff2ff1485d88 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.388578 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-a3118798-1a7b-4e35-9653-78e2338fa11d req-3e27ea32-d1a2-46b0-9ee1-ff2ff1485d88 service nova] Creating event network-changed:2b9adcd0-48a4-4233-a3fb-694dc9e1657f for instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f on hv-cinder-78836 May 26 15:11:42.394046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-a3118798-1a7b-4e35-9653-78e2338fa11d req-3e27ea32-d1a2-46b0-9ee1-ff2ff1485d88 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031018 May 26 15:11:42.394824 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 220/437] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:42.400927 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:42.401660 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:42.408142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.408793 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.409757 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.410203 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.507746 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7d2e8e36-23ed-45cf-96dc-b20125d094ac tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:42.518604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7d2e8e36-23ed-45cf-96dc-b20125d094ac tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1713 microversion: 2.1 time: 0.359423 May 26 15:11:42.519197 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 218/438] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:42 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1713 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:42.627669 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9be59762-8bc5-49fe-8fdf-07c5c857df8b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:42.628881 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9be59762-8bc5-49fe-8fdf-07c5c857df8b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:42.634901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:42.638627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9be59762-8bc5-49fe-8fdf-07c5c857df8b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.639334 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9be59762-8bc5-49fe-8fdf-07c5c857df8b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.640125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9be59762-8bc5-49fe-8fdf-07c5c857df8b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:42.640567 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9be59762-8bc5-49fe-8fdf-07c5c857df8b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:42.648547 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:42.651590 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:42.653949 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d944e8d1-d54f-4f91-9e4c-46eaf6f673f4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.257849 May 26 15:11:42.670783 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 221/439] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:42 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:42.853237 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9be59762-8bc5-49fe-8fdf-07c5c857df8b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:42.862386 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9be59762-8bc5-49fe-8fdf-07c5c857df8b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.247283 May 26 15:11:42.883849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 219/440] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:42 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:43.387665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e33d23b2-ab6c-47db-a08f-f6f3d90b1123 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:43.388907 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e33d23b2-ab6c-47db-a08f-f6f3d90b1123 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:43.412924 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e33d23b2-ab6c-47db-a08f-f6f3d90b1123 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:43.413405 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e33d23b2-ab6c-47db-a08f-f6f3d90b1123 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:43.414325 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e33d23b2-ab6c-47db-a08f-f6f3d90b1123 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:43.414776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e33d23b2-ab6c-47db-a08f-f6f3d90b1123 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:43.623695 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e33d23b2-ab6c-47db-a08f-f6f3d90b1123 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:43.634598 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e33d23b2-ab6c-47db-a08f-f6f3d90b1123 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.250763 May 26 15:11:43.636031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 222/441] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:43 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:43.679359 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:43.681210 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:43.692292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:43.692964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:43.693946 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:43.694730 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:43.883272 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-83e5be7c-24aa-4428-a3d3-906a98e4ef1d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:43.884010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-83e5be7c-24aa-4428-a3d3-906a98e4ef1d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:43.890820 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-83e5be7c-24aa-4428-a3d3-906a98e4ef1d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:43.891561 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-83e5be7c-24aa-4428-a3d3-906a98e4ef1d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:43.892659 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-83e5be7c-24aa-4428-a3d3-906a98e4ef1d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:43.893331 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-83e5be7c-24aa-4428-a3d3-906a98e4ef1d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:44.245566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:44.274050 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:44.279867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:44.299218 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1c4b78de-61db-4853-9bcc-50783b1a8f7d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.623766 May 26 15:11:44.301204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 220/442] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:43 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:44.520138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-83e5be7c-24aa-4428-a3d3-906a98e4ef1d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:44.532112 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-83e5be7c-24aa-4428-a3d3-906a98e4ef1d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.655335 May 26 15:11:44.533145 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 223/443] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:43 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:44.653220 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4f03e80a-ee66-4bf7-aa55-778e45e29f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:44.654255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4f03e80a-ee66-4bf7-aa55-778e45e29f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:44.662075 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f03e80a-ee66-4bf7-aa55-778e45e29f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:44.662642 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f03e80a-ee66-4bf7-aa55-778e45e29f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:44.664199 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f03e80a-ee66-4bf7-aa55-778e45e29f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:44.664853 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f03e80a-ee66-4bf7-aa55-778e45e29f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:44.996031 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4f03e80a-ee66-4bf7-aa55-778e45e29f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:45.004808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4f03e80a-ee66-4bf7-aa55-778e45e29f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.355968 May 26 15:11:45.016113 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 221/444] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:44 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:45.321690 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:45.322629 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:45.324981 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:45.332760 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:45.334045 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:45.335355 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:45.336606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:45.550370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-00899d08-7549-4b47-9898-9fefff8625b8 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:45.551205 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-00899d08-7549-4b47-9898-9fefff8625b8 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:45.566691 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00899d08-7549-4b47-9898-9fefff8625b8 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:45.567827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00899d08-7549-4b47-9898-9fefff8625b8 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:45.568518 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00899d08-7549-4b47-9898-9fefff8625b8 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:45.569544 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-00899d08-7549-4b47-9898-9fefff8625b8 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:45.704702 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:45.722543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:45.731305 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:45.738847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6362213c-4d8d-465c-8a7a-b0d79a5c2fa9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.422539 May 26 15:11:45.740160 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 224/445] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:45 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:45.754858 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-c92718f9-9e57-4df3-8510-1d4a041b2072 req-8cef2485-8e13-4455-ac23-c0145f5a4900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f535d-631c-4b12-97b0-d134f2042e1f", "name": "network-vif-plugged", "status": "completed", "tag": "930ee718-30cf-4a82-92d1-09e4d1723a9e"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:45.764812 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-c92718f9-9e57-4df3-8510-1d4a041b2072 req-8cef2485-8e13-4455-ac23-c0145f5a4900 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:45.765347 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-c92718f9-9e57-4df3-8510-1d4a041b2072 req-8cef2485-8e13-4455-ac23-c0145f5a4900 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:45.770460 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:11:45.781999 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-c92718f9-9e57-4df3-8510-1d4a041b2072 req-8cef2485-8e13-4455-ac23-c0145f5a4900 service nova] Creating event network-vif-plugged:930ee718-30cf-4a82-92d1-09e4d1723a9e for instance d60f535d-631c-4b12-97b0-d134f2042e1f on hv-cinder-78836 May 26 15:11:45.787757 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-c92718f9-9e57-4df3-8510-1d4a041b2072 req-8cef2485-8e13-4455-ac23-c0145f5a4900 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045971 May 26 15:11:45.788465 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 225/446] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:46.033779 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-745d3814-186e-4ce8-bdeb-b8250541f03f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:46.034906 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-745d3814-186e-4ce8-bdeb-b8250541f03f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:46.042320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-745d3814-186e-4ce8-bdeb-b8250541f03f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:46.043154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-745d3814-186e-4ce8-bdeb-b8250541f03f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:46.044207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-745d3814-186e-4ce8-bdeb-b8250541f03f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:46.044883 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-745d3814-186e-4ce8-bdeb-b8250541f03f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:46.299885 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-00899d08-7549-4b47-9898-9fefff8625b8 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:46.307929 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-00899d08-7549-4b47-9898-9fefff8625b8 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.762186 May 26 15:11:46.316963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 222/447] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:45 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:46.424599 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-745d3814-186e-4ce8-bdeb-b8250541f03f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:46.436930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-745d3814-186e-4ce8-bdeb-b8250541f03f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.407799 May 26 15:11:46.438376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 226/448] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:46 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:46.758266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:46.759132 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:46.766295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:46.766872 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:46.767793 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:46.768456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:46.986245 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:46.995973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:46.998024 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:46.999212 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fb3be452-cdf3-40bc-94bb-44571a7d3b99 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.245603 May 26 15:11:47.000122 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 223/449] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:46 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:47.324960 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7de59b9b-a132-4461-ae7b-f8f0a8b7560a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:47.325842 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7de59b9b-a132-4461-ae7b-f8f0a8b7560a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:47.334117 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7de59b9b-a132-4461-ae7b-f8f0a8b7560a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:47.335000 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7de59b9b-a132-4461-ae7b-f8f0a8b7560a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:47.335850 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7de59b9b-a132-4461-ae7b-f8f0a8b7560a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:47.336287 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7de59b9b-a132-4461-ae7b-f8f0a8b7560a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:47.456343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bfd1959f-ccfd-4056-82fd-2afde80284fc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:47.456858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bfd1959f-ccfd-4056-82fd-2afde80284fc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:47.484643 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bfd1959f-ccfd-4056-82fd-2afde80284fc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:47.485313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bfd1959f-ccfd-4056-82fd-2afde80284fc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:47.486233 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bfd1959f-ccfd-4056-82fd-2afde80284fc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:47.487154 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bfd1959f-ccfd-4056-82fd-2afde80284fc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:47.544621 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7de59b9b-a132-4461-ae7b-f8f0a8b7560a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:47.553331 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7de59b9b-a132-4461-ae7b-f8f0a8b7560a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1319 microversion: 2.1 time: 0.232989 May 26 15:11:47.561825 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 227/450] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:47 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:47.782077 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bfd1959f-ccfd-4056-82fd-2afde80284fc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:47.797581 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bfd1959f-ccfd-4056-82fd-2afde80284fc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.346114 May 26 15:11:47.798488 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 224/451] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:47 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:48.018156 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:48.019036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:48.026985 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:48.027932 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:48.029355 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:48.030019 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:48.272172 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:48.281546 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:48.284410 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:48.285916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a2f35062-5619-4e5f-ba17-a0198a6a72b5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.271854 May 26 15:11:48.286697 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 228/452] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:48 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:48.571666 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d58c274c-8542-4b93-b536-d6a6a7ff5018 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:48.572385 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d58c274c-8542-4b93-b536-d6a6a7ff5018 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:48.579375 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d58c274c-8542-4b93-b536-d6a6a7ff5018 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:48.580197 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d58c274c-8542-4b93-b536-d6a6a7ff5018 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:48.581820 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d58c274c-8542-4b93-b536-d6a6a7ff5018 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:48.582267 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d58c274c-8542-4b93-b536-d6a6a7ff5018 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:48.740085 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d58c274c-8542-4b93-b536-d6a6a7ff5018 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:48.751531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d58c274c-8542-4b93-b536-d6a6a7ff5018 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1509 microversion: 2.1 time: 0.184097 May 26 15:11:48.752743 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 225/453] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:48 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:48.814671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-539b8583-ed20-4c11-a86c-98c8a68a5141 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:48.822469 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-539b8583-ed20-4c11-a86c-98c8a68a5141 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:48.830365 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-539b8583-ed20-4c11-a86c-98c8a68a5141 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:48.831144 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-539b8583-ed20-4c11-a86c-98c8a68a5141 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:48.832081 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-539b8583-ed20-4c11-a86c-98c8a68a5141 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:48.832680 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-539b8583-ed20-4c11-a86c-98c8a68a5141 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:49.009398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-539b8583-ed20-4c11-a86c-98c8a68a5141 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:49.023807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-539b8583-ed20-4c11-a86c-98c8a68a5141 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.212462 May 26 15:11:49.025004 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 229/454] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:48 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:49.309272 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:49.310116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:49.321929 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:49.323413 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:49.324505 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:49.325230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:49.591303 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:49.603553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:49.605673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:49.606928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-103c8c47-56ec-48de-99fc-5aeecbf1db5f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.304272 May 26 15:11:49.607978 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 226/455] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:49 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:49.727169 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-119d637f-2e1e-466c-a17f-b8e4cda29e84 req-a17d6ed2-3bc3-4939-83c6-38975e1eb4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06cf01b4-e458-498b-990e-33b4171e1a14", "name": "network-vif-plugged", "status": "completed", "tag": "2e5306c2-86c5-4899-9abd-3ff6e390eb95"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:49.737100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-119d637f-2e1e-466c-a17f-b8e4cda29e84 req-a17d6ed2-3bc3-4939-83c6-38975e1eb4d1 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:49.737901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-119d637f-2e1e-466c-a17f-b8e4cda29e84 req-a17d6ed2-3bc3-4939-83c6-38975e1eb4d1 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:49.772831 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-119d637f-2e1e-466c-a17f-b8e4cda29e84 req-a17d6ed2-3bc3-4939-83c6-38975e1eb4d1 service nova] Creating event network-vif-plugged:2e5306c2-86c5-4899-9abd-3ff6e390eb95 for instance 06cf01b4-e458-498b-990e-33b4171e1a14 on hv-cinder-78836 May 26 15:11:49.790067 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-119d637f-2e1e-466c-a17f-b8e4cda29e84 req-a17d6ed2-3bc3-4939-83c6-38975e1eb4d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066767 May 26 15:11:49.791188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 230/456] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:50.057113 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-67b71d78-2fe5-4089-93cd-58b2169241d3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:50.072574 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-67b71d78-2fe5-4089-93cd-58b2169241d3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:50.082586 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-67b71d78-2fe5-4089-93cd-58b2169241d3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:50.083168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-67b71d78-2fe5-4089-93cd-58b2169241d3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:50.084061 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-67b71d78-2fe5-4089-93cd-58b2169241d3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:50.084612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-67b71d78-2fe5-4089-93cd-58b2169241d3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:50.599942 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-67b71d78-2fe5-4089-93cd-58b2169241d3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:50.609411 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-67b71d78-2fe5-4089-93cd-58b2169241d3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.566654 May 26 15:11:50.610020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 227/457] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:50 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:50.627039 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:50.628941 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:50.636014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:50.636327 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:50.637208 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:50.637806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:51.003765 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:51.015337 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:51.019260 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:51.024290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8d7ed057-cb37-441e-8a53-0e814673fddf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.401464 May 26 15:11:51.026570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 231/458] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:50 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:51.639052 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ec325d1a-3acb-44de-b563-1e29d4a132ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:51.642941 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ec325d1a-3acb-44de-b563-1e29d4a132ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:51.655828 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ec325d1a-3acb-44de-b563-1e29d4a132ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:51.656270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ec325d1a-3acb-44de-b563-1e29d4a132ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:51.657270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ec325d1a-3acb-44de-b563-1e29d4a132ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:51.658534 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ec325d1a-3acb-44de-b563-1e29d4a132ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:52.045846 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:52.046698 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:52.053512 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:52.054095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:52.054989 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:52.055502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:52.149152 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ec325d1a-3acb-44de-b563-1e29d4a132ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:52.161173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ec325d1a-3acb-44de-b563-1e29d4a132ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.534387 May 26 15:11:52.162321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 228/459] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:51 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:52.318113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:52.330268 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:52.332116 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:52.333751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c699fa79-7b4e-48cf-a4d8-a04d35a1f5c7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.292767 May 26 15:11:52.335199 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 232/460] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:52 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:53.186617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-13aa39ba-e4d2-45c8-aaa6-750a26efcf02 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:53.187330 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-13aa39ba-e4d2-45c8-aaa6-750a26efcf02 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:53.197622 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13aa39ba-e4d2-45c8-aaa6-750a26efcf02 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:53.200303 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13aa39ba-e4d2-45c8-aaa6-750a26efcf02 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:53.204005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13aa39ba-e4d2-45c8-aaa6-750a26efcf02 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:53.204951 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-13aa39ba-e4d2-45c8-aaa6-750a26efcf02 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:53.353900 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:53.355756 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:53.373188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:53.373676 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:53.386630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:53.396832 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:53.558427 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-13aa39ba-e4d2-45c8-aaa6-750a26efcf02 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:53.568602 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-13aa39ba-e4d2-45c8-aaa6-750a26efcf02 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.386872 May 26 15:11:53.582233 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 229/461] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:53 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:53.762992 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:53.783753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:53.785878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:53.787259 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-88b18ffa-b80b-45f0-a3b5-ffa1b402a667 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1808 microversion: 2.20 time: 0.438959 May 26 15:11:53.788151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 233/462] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:53 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1808 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:54.589574 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8a3dee9e-3ec8-424c-b364-71c11d020112 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:54.591061 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8a3dee9e-3ec8-424c-b364-71c11d020112 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:54.600711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8a3dee9e-3ec8-424c-b364-71c11d020112 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:54.601756 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8a3dee9e-3ec8-424c-b364-71c11d020112 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:54.602767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8a3dee9e-3ec8-424c-b364-71c11d020112 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:54.603214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8a3dee9e-3ec8-424c-b364-71c11d020112 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:54.776882 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8a3dee9e-3ec8-424c-b364-71c11d020112 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:54.786445 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8a3dee9e-3ec8-424c-b364-71c11d020112 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.201618 May 26 15:11:54.800010 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 230/463] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:54 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:54.826314 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:54.827646 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:54.834970 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:54.836001 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:54.836847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:54.837349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:55.003285 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:55.017474 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:55.018983 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:55.020199 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e2b0dd35-2ed0-45b2-9565-ec914405d607 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1795 microversion: 2.20 time: 0.208392 May 26 15:11:55.023388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 234/464] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:11:54 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1795 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:11:55.590369 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1176d42d-99c5-4ef1-b910-81d4f78de8ce tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Action: 'create', calling method: .version_select at 0x7ff9668e11f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2104449665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBk845t0hGkfVHJ7WpMohbmAEUkGjWZdyUN3bxIbStt5bxOaoo9TK2u6vYGVHpcU93YL1izVt8DYScJwGY9FlIgMo7nXmryqOE6l6oBzPfZKp12lUKljPTmoJ6BZNlfSnQ=="}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:55.607312 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-1176d42d-99c5-4ef1-b910-81d4f78de8ce tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Getting quotas for project 9c5cd1d25e6146bd93bd90286f668b9d. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:11:55.611563 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-1176d42d-99c5-4ef1-b910-81d4f78de8ce tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Getting quotas for user e4afc097467f4c26a6d4da0e48b8303f and project 9c5cd1d25e6146bd93bd90286f668b9d. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:11:55.635148 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1176d42d-99c5-4ef1-b910-81d4f78de8ce tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.251491 May 26 15:11:55.635848 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 231/465] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:11:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:55.813100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1ce604d8-9eff-41b3-8c7d-7a7d1f3c98a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:55.813100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1ce604d8-9eff-41b3-8c7d-7a7d1f3c98a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:55.820077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1ce604d8-9eff-41b3-8c7d-7a7d1f3c98a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:55.820540 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1ce604d8-9eff-41b3-8c7d-7a7d1f3c98a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:55.821318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1ce604d8-9eff-41b3-8c7d-7a7d1f3c98a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:55.821779 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1ce604d8-9eff-41b3-8c7d-7a7d1f3c98a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:55.995262 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1ce604d8-9eff-41b3-8c7d-7a7d1f3c98a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:56.003469 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1ce604d8-9eff-41b3-8c7d-7a7d1f3c98a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.195863 May 26 15:11:56.004103 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 235/466] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:55 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:57.020539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-451b6b05-8668-4aed-8a7f-011d9282e029 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:57.021157 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-451b6b05-8668-4aed-8a7f-011d9282e029 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:57.029143 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-451b6b05-8668-4aed-8a7f-011d9282e029 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:57.029921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-451b6b05-8668-4aed-8a7f-011d9282e029 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:57.030924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-451b6b05-8668-4aed-8a7f-011d9282e029 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:57.031372 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-451b6b05-8668-4aed-8a7f-011d9282e029 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:57.233901 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-451b6b05-8668-4aed-8a7f-011d9282e029 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:57.245032 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-451b6b05-8668-4aed-8a7f-011d9282e029 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.228095 May 26 15:11:57.245830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 232/467] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:57 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:58.262541 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-81db7630-233f-4178-8444-aaa3ac8acefc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:58.263186 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-81db7630-233f-4178-8444-aaa3ac8acefc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:58.270122 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-81db7630-233f-4178-8444-aaa3ac8acefc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:58.270808 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-81db7630-233f-4178-8444-aaa3ac8acefc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:58.271585 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-81db7630-233f-4178-8444-aaa3ac8acefc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:58.272030 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-81db7630-233f-4178-8444-aaa3ac8acefc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:58.421122 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-81db7630-233f-4178-8444-aaa3ac8acefc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:58.429142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-81db7630-233f-4178-8444-aaa3ac8acefc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.170561 May 26 15:11:58.438351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 236/468] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:58 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:59.445771 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-56b72880-ae16-4137-8eba-f327da6ab6ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:59.446428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-56b72880-ae16-4137-8eba-f327da6ab6ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:11:59.457506 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56b72880-ae16-4137-8eba-f327da6ab6ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:59.457976 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56b72880-ae16-4137-8eba-f327da6ab6ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:59.458774 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56b72880-ae16-4137-8eba-f327da6ab6ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:11:59.459220 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56b72880-ae16-4137-8eba-f327da6ab6ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:11:59.598087 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56b72880-ae16-4137-8eba-f327da6ab6ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:59.605871 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-56b72880-ae16-4137-8eba-f327da6ab6ed tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.164384 May 26 15:11:59.606456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 233/469] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:11:59 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:00.624940 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-817073ca-9650-4ec1-899d-647f83e24c0f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:00.625606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-817073ca-9650-4ec1-899d-647f83e24c0f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:00.634109 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-817073ca-9650-4ec1-899d-647f83e24c0f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:00.635714 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-817073ca-9650-4ec1-899d-647f83e24c0f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:00.636486 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-817073ca-9650-4ec1-899d-647f83e24c0f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:00.636925 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-817073ca-9650-4ec1-899d-647f83e24c0f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:00.769124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-817073ca-9650-4ec1-899d-647f83e24c0f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:00.777174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-817073ca-9650-4ec1-899d-647f83e24c0f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.157973 May 26 15:12:00.777763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 237/470] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:00 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:01.795130 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4c14b3e2-dba4-4bb0-8030-df2c337e1c6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:01.795737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4c14b3e2-dba4-4bb0-8030-df2c337e1c6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:01.798177 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:01.803916 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c14b3e2-dba4-4bb0-8030-df2c337e1c6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:01.804361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c14b3e2-dba4-4bb0-8030-df2c337e1c6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:01.805123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c14b3e2-dba4-4bb0-8030-df2c337e1c6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:01.805941 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4c14b3e2-dba4-4bb0-8030-df2c337e1c6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:01.944552 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4c14b3e2-dba4-4bb0-8030-df2c337e1c6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:01.951028 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:01.965789 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4c14b3e2-dba4-4bb0-8030-df2c337e1c6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.174230 May 26 15:12:01.966733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 234/471] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:01 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:02.989398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-37ccd859-65b5-4b93-a393-3af130ba410a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:02.990035 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-37ccd859-65b5-4b93-a393-3af130ba410a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:02.996721 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-37ccd859-65b5-4b93-a393-3af130ba410a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:02.997176 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-37ccd859-65b5-4b93-a393-3af130ba410a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:02.997969 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-37ccd859-65b5-4b93-a393-3af130ba410a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:02.998407 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-37ccd859-65b5-4b93-a393-3af130ba410a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:03.130019 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-37ccd859-65b5-4b93-a393-3af130ba410a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:03.138098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-37ccd859-65b5-4b93-a393-3af130ba410a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.152614 May 26 15:12:03.138663 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 238/472] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:02 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:04.155341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-90f634ff-9c42-4715-9cbc-f50508f2b4c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:04.155953 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-90f634ff-9c42-4715-9cbc-f50508f2b4c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:04.163636 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-90f634ff-9c42-4715-9cbc-f50508f2b4c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:04.164093 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-90f634ff-9c42-4715-9cbc-f50508f2b4c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:04.165159 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-90f634ff-9c42-4715-9cbc-f50508f2b4c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:04.165904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-90f634ff-9c42-4715-9cbc-f50508f2b4c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:04.309552 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-90f634ff-9c42-4715-9cbc-f50508f2b4c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:04.317581 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-90f634ff-9c42-4715-9cbc-f50508f2b4c2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.166427 May 26 15:12:04.318162 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 235/473] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:04 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:05.335788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ad8b6429-d586-4664-8ba5-6cd7028bdb6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:05.336514 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ad8b6429-d586-4664-8ba5-6cd7028bdb6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:05.343967 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ad8b6429-d586-4664-8ba5-6cd7028bdb6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:05.344569 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ad8b6429-d586-4664-8ba5-6cd7028bdb6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:05.345333 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ad8b6429-d586-4664-8ba5-6cd7028bdb6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:05.345799 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ad8b6429-d586-4664-8ba5-6cd7028bdb6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:05.682757 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ad8b6429-d586-4664-8ba5-6cd7028bdb6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:05.690608 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ad8b6429-d586-4664-8ba5-6cd7028bdb6c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.359016 May 26 15:12:05.691190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 239/474] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:05 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:06.708136 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1c77c882-5fdb-44b2-bc02-8b887f1b944b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:06.708757 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1c77c882-5fdb-44b2-bc02-8b887f1b944b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:06.711498 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=4 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:06.717125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c77c882-5fdb-44b2-bc02-8b887f1b944b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:06.717614 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c77c882-5fdb-44b2-bc02-8b887f1b944b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:06.718384 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c77c882-5fdb-44b2-bc02-8b887f1b944b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:06.718825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c77c882-5fdb-44b2-bc02-8b887f1b944b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:06.847060 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c77c882-5fdb-44b2-bc02-8b887f1b944b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:06.854760 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1c77c882-5fdb-44b2-bc02-8b887f1b944b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.150457 May 26 15:12:06.855266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 236/475] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:06 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:07.872182 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7c301196-8d99-4912-85aa-2a8b9d9fafc7 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:07.872805 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7c301196-8d99-4912-85aa-2a8b9d9fafc7 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:07.879575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7c301196-8d99-4912-85aa-2a8b9d9fafc7 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:07.879950 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7c301196-8d99-4912-85aa-2a8b9d9fafc7 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:07.880714 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7c301196-8d99-4912-85aa-2a8b9d9fafc7 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:07.881150 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7c301196-8d99-4912-85aa-2a8b9d9fafc7 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:08.013858 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7c301196-8d99-4912-85aa-2a8b9d9fafc7 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:08.021709 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7c301196-8d99-4912-85aa-2a8b9d9fafc7 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.153679 May 26 15:12:08.022293 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 240/476] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:07 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:09.039638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a7b803a8-25e7-4e2e-9a22-6ed2b4c0b83a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:09.040174 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a7b803a8-25e7-4e2e-9a22-6ed2b4c0b83a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:09.046689 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7b803a8-25e7-4e2e-9a22-6ed2b4c0b83a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:09.047135 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7b803a8-25e7-4e2e-9a22-6ed2b4c0b83a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:09.047884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7b803a8-25e7-4e2e-9a22-6ed2b4c0b83a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:09.048315 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a7b803a8-25e7-4e2e-9a22-6ed2b4c0b83a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:09.183190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a7b803a8-25e7-4e2e-9a22-6ed2b4c0b83a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:09.190664 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a7b803a8-25e7-4e2e-9a22-6ed2b4c0b83a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.155424 May 26 15:12:09.191232 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 237/477] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:09 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:10.207150 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-95695ed4-c029-4cd6-9db9-c635ee42234a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:10.207757 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-95695ed4-c029-4cd6-9db9-c635ee42234a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:10.214291 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95695ed4-c029-4cd6-9db9-c635ee42234a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:10.214738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95695ed4-c029-4cd6-9db9-c635ee42234a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:10.215488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95695ed4-c029-4cd6-9db9-c635ee42234a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:10.215922 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95695ed4-c029-4cd6-9db9-c635ee42234a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:10.347813 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-95695ed4-c029-4cd6-9db9-c635ee42234a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:10.355814 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-95695ed4-c029-4cd6-9db9-c635ee42234a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1502 microversion: 2.1 time: 0.151866 May 26 15:12:10.356380 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 241/478] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:10 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:10.374706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7f434d7-cf7f-42da-9f52-177473c66b7e"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:10.375773 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:10.382467 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:10.382924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:10.383696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:10.384157 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:10.408018 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] HTTP exception thrown: Cannot 'attach_volume' instance ef06b3f7-244b-42fd-8657-59708a3b66f5 while it is in vm_state rescued May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Request method failure captured: May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: POST /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5/os-volume_attachments HTTP/1.1 May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 74 May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5hRvwCh_0EjDjPJrKGPN-nNnnn3ra8nC-wiV8Z3ZLol3S-_v1z_BoI1WppEzWWOsw2KXu-v_YyNZ8AZKmicfOwsWNz89ANHmuHTiYJbSDuKqzhbIZKw2QZmRDOpCH9qB6dPcgVEuqPBsWBqUu-lMOyym4jaYon5YIfCwIEe5Ro_pMw May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:12:10.409767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_45e3fe61cc704411ac645e5935b9d258", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/45e3fe61cc704411ac645e5935b9d258"}]}] May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 27172e53a12a437c9d57a75a95727d71 May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {"volumeAttachment": {"volumeId": "f7f434d7-cf7f-42da-9f52-177473c66b7e"}} May 26 15:12:10.411341 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Cannot 'attach_volume' instance ef06b3f7-244b-42fd-8657-59708a3b66f5 while it is in vm_state rescued May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'server_id': 'ef06b3f7-244b-42fd-8657-59708a3b66f5', 'body': {'volumeAttachment': {'volumeId': 'f7f434d7-cf7f-42da-9f52-177473c66b7e'}}} May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ef06b3f7-244b-42fd-8657-59708a3b66f5 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:12:10.412442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ef06b3f7-244b-42fd-8657-59708a3b66f5 while it is in vm_state rescued May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:12:10.413830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:12:10.415235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:12:10.415235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:12:10.415235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ef06b3f7-244b-42fd-8657-59708a3b66f5 while it is in vm_state rescued May 26 15:12:10.415235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:12:10.415235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Returning 409 to user: Cannot 'attach_volume' instance ef06b3f7-244b-42fd-8657-59708a3b66f5 while it is in vm_state rescued {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:12:10.415235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b7acece4-7f01-4716-bd8f-635b321811b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041564 May 26 15:12:10.415235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 238/479] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:12:10 2022] POST /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 15:12:10.420008 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f148a570-57ee-4a3a-88f4-86b1349d13eb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:10.420533 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f148a570-57ee-4a3a-88f4-86b1349d13eb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:10.426492 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f148a570-57ee-4a3a-88f4-86b1349d13eb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:10.426941 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f148a570-57ee-4a3a-88f4-86b1349d13eb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:10.427691 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f148a570-57ee-4a3a-88f4-86b1349d13eb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:10.428123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f148a570-57ee-4a3a-88f4-86b1349d13eb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:10.468868 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:10.494715 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f148a570-57ee-4a3a-88f4-86b1349d13eb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5/action" status: 202 len: 0 microversion: 2.1 time: 0.078433 May 26 15:12:10.496273 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 242/480] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:12:10 2022] POST /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:12:10.504246 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-66277837-c8a3-436b-bdfb-c73b39b1ede3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:10.504825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-66277837-c8a3-436b-bdfb-c73b39b1ede3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:10.512222 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66277837-c8a3-436b-bdfb-c73b39b1ede3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:10.512675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66277837-c8a3-436b-bdfb-c73b39b1ede3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:10.513520 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66277837-c8a3-436b-bdfb-c73b39b1ede3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:10.513973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66277837-c8a3-436b-bdfb-c73b39b1ede3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:10.736373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-66277837-c8a3-436b-bdfb-c73b39b1ede3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:10.744149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-66277837-c8a3-436b-bdfb-c73b39b1ede3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1510 microversion: 2.1 time: 0.243738 May 26 15:12:10.744715 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 239/481] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:10 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:11.662809 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-13eb29b0-02f0-4962-979c-4145e864797a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "632b160f-4c86-4ff0-aaf6-2e32f3641b77", "device": "/dev/sdb"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:11.664520 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-13eb29b0-02f0-4962-979c-4145e864797a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:11.672681 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13eb29b0-02f0-4962-979c-4145e864797a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:11.673166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13eb29b0-02f0-4962-979c-4145e864797a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:11.674007 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13eb29b0-02f0-4962-979c-4145e864797a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:11.674483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13eb29b0-02f0-4962-979c-4145e864797a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:11.762880 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6744a9d7-e271-45a6-b8be-ad86ff392998 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:11.763500 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6744a9d7-e271-45a6-b8be-ad86ff392998 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:11.770281 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6744a9d7-e271-45a6-b8be-ad86ff392998 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:11.770769 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6744a9d7-e271-45a6-b8be-ad86ff392998 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:11.771539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6744a9d7-e271-45a6-b8be-ad86ff392998 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:11.771987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6744a9d7-e271-45a6-b8be-ad86ff392998 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:11.909722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6744a9d7-e271-45a6-b8be-ad86ff392998 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:11.918203 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6744a9d7-e271-45a6-b8be-ad86ff392998 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1510 microversion: 2.1 time: 0.159793 May 26 15:12:11.918778 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 240/482] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:11 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:12.935748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-822b6738-f8eb-4001-b133-f0bfe41f3a4c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:12.936376 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-822b6738-f8eb-4001-b133-f0bfe41f3a4c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:12.942995 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-822b6738-f8eb-4001-b133-f0bfe41f3a4c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:12.943453 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-822b6738-f8eb-4001-b133-f0bfe41f3a4c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:12.944229 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-822b6738-f8eb-4001-b133-f0bfe41f3a4c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:12.944674 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-822b6738-f8eb-4001-b133-f0bfe41f3a4c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:13.075079 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-822b6738-f8eb-4001-b133-f0bfe41f3a4c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:13.082567 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-822b6738-f8eb-4001-b133-f0bfe41f3a4c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1510 microversion: 2.1 time: 0.151318 May 26 15:12:13.083140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 241/483] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:12 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:13.516896 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-13eb29b0-02f0-4962-979c-4145e864797a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "POST /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.860050 May 26 15:12:13.517694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 243/484] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:12:11 2022] POST /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f/os-volume_attachments => generated 194 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:14.100020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-faa4d3d1-ead2-4562-a71a-580e2d5d020a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:14.100627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-faa4d3d1-ead2-4562-a71a-580e2d5d020a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:14.107214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-faa4d3d1-ead2-4562-a71a-580e2d5d020a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:14.107657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-faa4d3d1-ead2-4562-a71a-580e2d5d020a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:14.108416 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-faa4d3d1-ead2-4562-a71a-580e2d5d020a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:14.108851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-faa4d3d1-ead2-4562-a71a-580e2d5d020a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:14.238038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-faa4d3d1-ead2-4562-a71a-580e2d5d020a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:14.245495 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-faa4d3d1-ead2-4562-a71a-580e2d5d020a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1510 microversion: 2.1 time: 0.149296 May 26 15:12:14.246811 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 242/485] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:14 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:15.265321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-08d2c2ec-2a59-4165-b360-8746272566c9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:15.265975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-08d2c2ec-2a59-4165-b360-8746272566c9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:15.272612 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08d2c2ec-2a59-4165-b360-8746272566c9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:15.273054 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08d2c2ec-2a59-4165-b360-8746272566c9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:15.274159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08d2c2ec-2a59-4165-b360-8746272566c9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:15.274605 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08d2c2ec-2a59-4165-b360-8746272566c9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:15.410108 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-08d2c2ec-2a59-4165-b360-8746272566c9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:15.418703 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-08d2c2ec-2a59-4165-b360-8746272566c9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1516 microversion: 2.1 time: 0.158658 May 26 15:12:15.419274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 244/486] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:15 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:16.742186 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3fef8ddc-c187-467e-9535-af371b59b657 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'create', calling method: .version_select at 0x7ff966c15820>, body: {"keypair": {"name": "tempest-keypair-2146116841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFb4rbyQzwQhdzI95e1Nv2YO/rJQxdmwCgxWB1vYmvd61rKg0NH2eGqANvy1nSUBrpwyicQvcEO+DpkeDg0E4wOs4jp2BrksSwHWyduSmSAz13TMgEgC/3nl3pnE+ZyXNg=="}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:16.756566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-3fef8ddc-c187-467e-9535-af371b59b657 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Getting quotas for project 45e3fe61cc704411ac645e5935b9d258. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:12:16.760447 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-3fef8ddc-c187-467e-9535-af371b59b657 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Getting quotas for user 27172e53a12a437c9d57a75a95727d71 and project 45e3fe61cc704411ac645e5935b9d258. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:12:16.782921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3fef8ddc-c187-467e-9535-af371b59b657 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044599 May 26 15:12:16.783518 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 243/487] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:12:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:18.082515 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1381941959", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bf2593f-6b7e-48a8-9b32-aea452c29f00"}], "security_groups": [{"name": "tempest-securitygroup--359862486"}], "key_name": "tempest-keypair-2146116841", "user_data": "}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:18.091604 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=42 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:18.187343 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.network.neutron [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] validate_networks() for [('8bf2593f-6b7e-48a8-9b32-aea452c29f00', None, None, None, None, None)] {{(pid=117724) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:12:18.553287 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Flavor limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:12:18.553736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Image limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:12:18.554244 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Flavor pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:12:18.554657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Image pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:12:18.555068 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:12:18.563871 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:18.564319 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:18.565112 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:18.565587 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:18.582480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Getting quotas for project 45e3fe61cc704411ac645e5935b9d258. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:12:18.586566 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Getting quotas for user 27172e53a12a437c9d57a75a95727d71 and project 45e3fe61cc704411ac645e5935b9d258. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:12:18.598201 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Going to run 1 instances... {{(pid=117724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:12:18.600471 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:12:18.646873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c2c298c9-1d0d-4416-aba3-e2ed6e9972d8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.568640 May 26 15:12:18.647510 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 245/488] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:12:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:12:18.658491 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3defb802-4150-4e31-900c-4008496be932 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:18.659112 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3defb802-4150-4e31-900c-4008496be932 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:18.717726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3defb802-4150-4e31-900c-4008496be932 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:18.725433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3defb802-4150-4e31-900c-4008496be932 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1246 microversion: 2.1 time: 0.071031 May 26 15:12:18.726102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 244/489] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:18 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:19.742352 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bc5f165d-105d-49e1-89da-8bb7ab272a53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:19.742973 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bc5f165d-105d-49e1-89da-8bb7ab272a53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:19.751292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bc5f165d-105d-49e1-89da-8bb7ab272a53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:19.751748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bc5f165d-105d-49e1-89da-8bb7ab272a53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:19.752521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bc5f165d-105d-49e1-89da-8bb7ab272a53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:19.752971 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bc5f165d-105d-49e1-89da-8bb7ab272a53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:19.815826 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bc5f165d-105d-49e1-89da-8bb7ab272a53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:19.823269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bc5f165d-105d-49e1-89da-8bb7ab272a53 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1298 microversion: 2.1 time: 0.084817 May 26 15:12:19.823826 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 246/490] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:19 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:20.843438 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f1c9986e-8543-4b37-83de-9351c58fb284 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:20.844044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f1c9986e-8543-4b37-83de-9351c58fb284 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:20.850613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1c9986e-8543-4b37-83de-9351c58fb284 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:20.851109 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1c9986e-8543-4b37-83de-9351c58fb284 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:20.851856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1c9986e-8543-4b37-83de-9351c58fb284 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:20.852332 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f1c9986e-8543-4b37-83de-9351c58fb284 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:20.937611 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f1c9986e-8543-4b37-83de-9351c58fb284 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:20.945291 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f1c9986e-8543-4b37-83de-9351c58fb284 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1304 microversion: 2.1 time: 0.106367 May 26 15:12:20.945884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 245/491] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:20 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:21.378480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-238183976", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2104449665", "security_groups": [{"name": "tempest-secgroup-smoke-1868104037"}], "networks": [{"uuid": "68359501-3537-436b-ae78-35604426e377"}], "block_device_mapping_v2": [{"uuid": "e74fb2f2-1fe6-4c4d-8214-ae8e0c80e0f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:21.587017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.network.neutron [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] validate_networks() for [('68359501-3537-436b-ae78-35604426e377', None, None, None, None, None)] {{(pid=117724) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:12:21.963372 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-74697cf3-ff4b-47c3-a47f-2991afe931e6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:21.966415 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-74697cf3-ff4b-47c3-a47f-2991afe931e6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:21.993848 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-74697cf3-ff4b-47c3-a47f-2991afe931e6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:21.994430 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-74697cf3-ff4b-47c3-a47f-2991afe931e6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:21.997576 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-74697cf3-ff4b-47c3-a47f-2991afe931e6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:21.998318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-74697cf3-ff4b-47c3-a47f-2991afe931e6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:22.281108 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-74697cf3-ff4b-47c3-a47f-2991afe931e6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:22.283804 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Flavor limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:12:22.284424 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Image limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:12:22.285024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Flavor pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:12:22.285895 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Image pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:12:22.286438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:12:22.288749 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-74697cf3-ff4b-47c3-a47f-2991afe931e6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.329472 May 26 15:12:22.289324 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 246/492] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:21 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:22.301185 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:22.301844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:22.302634 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:22.303068 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:22.321188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Getting quotas for project 9c5cd1d25e6146bd93bd90286f668b9d. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:12:22.324859 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Getting quotas for user e4afc097467f4c26a6d4da0e48b8303f and project 9c5cd1d25e6146bd93bd90286f668b9d. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:12:22.357188 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-81fa0e0b-3461-4a1d-b2f7-57518484473b req-4ee69a7a-f34b-48c5-9523-bcc9d0b760c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4682a8fb-1ed3-492f-963e-7befa1cf839d", "tag": "af1b1d4b-d86d-4d01-b349-f19b08f5f132"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:22.377800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-81fa0e0b-3461-4a1d-b2f7-57518484473b req-4ee69a7a-f34b-48c5-9523-bcc9d0b760c8 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:22.378252 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-81fa0e0b-3461-4a1d-b2f7-57518484473b req-4ee69a7a-f34b-48c5-9523-bcc9d0b760c8 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:22.391980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-81fa0e0b-3461-4a1d-b2f7-57518484473b req-4ee69a7a-f34b-48c5-9523-bcc9d0b760c8 service nova] Creating event network-changed:af1b1d4b-d86d-4d01-b349-f19b08f5f132 for instance 4682a8fb-1ed3-492f-963e-7befa1cf839d on hv-cinder-78836 May 26 15:12:22.397870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Going to run 1 instances... {{(pid=117724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:12:22.398314 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-81fa0e0b-3461-4a1d-b2f7-57518484473b req-4ee69a7a-f34b-48c5-9523-bcc9d0b760c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046640 May 26 15:12:22.398668 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 247/493] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:22.403592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e74fb2f2-1fe6-4c4d-8214-ae8e0c80e0f8',volume_size=None,volume_type=None)] {{(pid=117724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:12:22.544142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-612fa25e-2b7b-4999-8bcc-b6a6f1b6887b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.169587 May 26 15:12:22.544945 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 247/494] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:12:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:12:22.557172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c9aba781-c000-4c06-8753-25b96cbcf78a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:22.559216 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c9aba781-c000-4c06-8753-25b96cbcf78a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:22.650665 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c9aba781-c000-4c06-8753-25b96cbcf78a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:22.659075 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c9aba781-c000-4c06-8753-25b96cbcf78a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1088 microversion: 2.1 time: 0.107494 May 26 15:12:22.659735 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 248/495] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:22 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1088 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:23.308014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0027b174-f905-4fe8-8d16-a339d23b4afb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:23.308958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0027b174-f905-4fe8-8d16-a339d23b4afb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:23.316300 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0027b174-f905-4fe8-8d16-a339d23b4afb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:23.316865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0027b174-f905-4fe8-8d16-a339d23b4afb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:23.317829 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0027b174-f905-4fe8-8d16-a339d23b4afb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:23.318412 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0027b174-f905-4fe8-8d16-a339d23b4afb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:23.474405 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0027b174-f905-4fe8-8d16-a339d23b4afb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:23.483119 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0027b174-f905-4fe8-8d16-a339d23b4afb tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.179646 May 26 15:12:23.483693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 248/496] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:23 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:23.676916 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-47d2bc2f-b63f-4748-9667-58b94b464f75 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:23.677485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-47d2bc2f-b63f-4748-9667-58b94b464f75 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:23.685147 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47d2bc2f-b63f-4748-9667-58b94b464f75 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:23.685619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47d2bc2f-b63f-4748-9667-58b94b464f75 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:23.686391 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47d2bc2f-b63f-4748-9667-58b94b464f75 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:23.686933 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47d2bc2f-b63f-4748-9667-58b94b464f75 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:23.757410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-47d2bc2f-b63f-4748-9667-58b94b464f75 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:23.766127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-47d2bc2f-b63f-4748-9667-58b94b464f75 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1186 microversion: 2.1 time: 0.093471 May 26 15:12:23.767031 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 249/497] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:23 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:24.500522 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b567a11b-0d8b-4cc7-a54d-6645f45f6d89 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:24.501128 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b567a11b-0d8b-4cc7-a54d-6645f45f6d89 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:24.507744 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b567a11b-0d8b-4cc7-a54d-6645f45f6d89 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:24.508188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b567a11b-0d8b-4cc7-a54d-6645f45f6d89 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:24.508974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b567a11b-0d8b-4cc7-a54d-6645f45f6d89 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:24.509512 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b567a11b-0d8b-4cc7-a54d-6645f45f6d89 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:24.639284 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b567a11b-0d8b-4cc7-a54d-6645f45f6d89 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:24.647223 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b567a11b-0d8b-4cc7-a54d-6645f45f6d89 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.151021 May 26 15:12:24.647793 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 249/498] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:24 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:24.783703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6bf10e24-69d8-4635-884d-f441027bdd1b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:24.784228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6bf10e24-69d8-4635-884d-f441027bdd1b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:24.790991 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bf10e24-69d8-4635-884d-f441027bdd1b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:24.791436 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bf10e24-69d8-4635-884d-f441027bdd1b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:24.792189 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bf10e24-69d8-4635-884d-f441027bdd1b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:24.792665 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6bf10e24-69d8-4635-884d-f441027bdd1b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:24.852200 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6bf10e24-69d8-4635-884d-f441027bdd1b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:24.859560 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6bf10e24-69d8-4635-884d-f441027bdd1b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1186 microversion: 2.1 time: 0.079763 May 26 15:12:24.860119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 250/499] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:24 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1186 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:25.664162 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bb17427c-0995-4ffe-b872-b37a917f0523 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:25.664699 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bb17427c-0995-4ffe-b872-b37a917f0523 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:25.671984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bb17427c-0995-4ffe-b872-b37a917f0523 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:25.672433 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bb17427c-0995-4ffe-b872-b37a917f0523 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:25.673191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bb17427c-0995-4ffe-b872-b37a917f0523 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:25.673672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bb17427c-0995-4ffe-b872-b37a917f0523 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:25.804120 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bb17427c-0995-4ffe-b872-b37a917f0523 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:25.811497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bb17427c-0995-4ffe-b872-b37a917f0523 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.151229 May 26 15:12:25.812051 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 250/500] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:25 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:25.876635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7d2998eb-445a-495a-9926-c747be81c5d1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:25.877338 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7d2998eb-445a-495a-9926-c747be81c5d1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:25.883781 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7d2998eb-445a-495a-9926-c747be81c5d1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:25.884232 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7d2998eb-445a-495a-9926-c747be81c5d1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:25.884996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7d2998eb-445a-495a-9926-c747be81c5d1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:25.885432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7d2998eb-445a-495a-9926-c747be81c5d1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:25.945390 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7d2998eb-445a-495a-9926-c747be81c5d1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:25.953265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7d2998eb-445a-495a-9926-c747be81c5d1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1194 microversion: 2.1 time: 0.080473 May 26 15:12:25.953855 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 251/501] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:25 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:26.829347 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-28c85ee2-98c1-4598-a11b-c9cf58be3e5e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:26.830026 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-28c85ee2-98c1-4598-a11b-c9cf58be3e5e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:26.838296 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28c85ee2-98c1-4598-a11b-c9cf58be3e5e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:26.838961 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28c85ee2-98c1-4598-a11b-c9cf58be3e5e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:26.840620 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28c85ee2-98c1-4598-a11b-c9cf58be3e5e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:26.841297 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28c85ee2-98c1-4598-a11b-c9cf58be3e5e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:26.971758 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d748d538-9c16-4d5f-8754-39ebd0e8c055 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:26.973097 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d748d538-9c16-4d5f-8754-39ebd0e8c055 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:26.979843 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d748d538-9c16-4d5f-8754-39ebd0e8c055 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:26.980538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d748d538-9c16-4d5f-8754-39ebd0e8c055 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:26.981536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d748d538-9c16-4d5f-8754-39ebd0e8c055 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:26.981977 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d748d538-9c16-4d5f-8754-39ebd0e8c055 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:26.988208 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-28c85ee2-98c1-4598-a11b-c9cf58be3e5e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:26.998523 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-28c85ee2-98c1-4598-a11b-c9cf58be3e5e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.172953 May 26 15:12:26.999162 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 251/502] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:26 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:27.056484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d748d538-9c16-4d5f-8754-39ebd0e8c055 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:27.064699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d748d538-9c16-4d5f-8754-39ebd0e8c055 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1204 microversion: 2.1 time: 0.097534 May 26 15:12:27.065277 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 252/503] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:26 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:28.015797 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-45fa346b-9f91-4286-94fd-69647284c816 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:28.016361 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-45fa346b-9f91-4286-94fd-69647284c816 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:28.022812 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45fa346b-9f91-4286-94fd-69647284c816 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:28.023258 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45fa346b-9f91-4286-94fd-69647284c816 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:28.024100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45fa346b-9f91-4286-94fd-69647284c816 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:28.024535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45fa346b-9f91-4286-94fd-69647284c816 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:28.082290 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-573e394c-19c9-45d2-9d0e-f829bdcc8ace tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:28.082902 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-573e394c-19c9-45d2-9d0e-f829bdcc8ace tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:28.089994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-573e394c-19c9-45d2-9d0e-f829bdcc8ace tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:28.090441 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-573e394c-19c9-45d2-9d0e-f829bdcc8ace tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:28.091229 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-573e394c-19c9-45d2-9d0e-f829bdcc8ace tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:28.091673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-573e394c-19c9-45d2-9d0e-f829bdcc8ace tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:28.197621 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-45fa346b-9f91-4286-94fd-69647284c816 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:28.205696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-45fa346b-9f91-4286-94fd-69647284c816 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.194022 May 26 15:12:28.206381 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 252/504] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:28 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:28.246690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-573e394c-19c9-45d2-9d0e-f829bdcc8ace tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:28.254247 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-573e394c-19c9-45d2-9d0e-f829bdcc8ace tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1272 microversion: 2.1 time: 0.175829 May 26 15:12:28.254811 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 253/505] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:28 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:29.222879 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-cb684f15-0ae9-443f-b1b9-950ba6398be0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:29.223446 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cb684f15-0ae9-443f-b1b9-950ba6398be0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:29.231255 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cb684f15-0ae9-443f-b1b9-950ba6398be0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:29.231699 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cb684f15-0ae9-443f-b1b9-950ba6398be0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:29.232459 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cb684f15-0ae9-443f-b1b9-950ba6398be0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:29.232892 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cb684f15-0ae9-443f-b1b9-950ba6398be0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:29.271853 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-12fef8cd-b051-439c-b077-a7a926968141 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:29.272574 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-12fef8cd-b051-439c-b077-a7a926968141 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:29.279184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-12fef8cd-b051-439c-b077-a7a926968141 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:29.279619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-12fef8cd-b051-439c-b077-a7a926968141 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:29.280386 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-12fef8cd-b051-439c-b077-a7a926968141 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:29.280829 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-12fef8cd-b051-439c-b077-a7a926968141 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:29.420221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-cb684f15-0ae9-443f-b1b9-950ba6398be0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:29.427532 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-cb684f15-0ae9-443f-b1b9-950ba6398be0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.209098 May 26 15:12:29.428101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 253/506] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:29 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:29.447636 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-12fef8cd-b051-439c-b077-a7a926968141 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:29.455765 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-12fef8cd-b051-439c-b077-a7a926968141 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1272 microversion: 2.1 time: 0.187739 May 26 15:12:29.456325 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 254/507] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:29 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:30.445291 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-39d1337d-e17f-4257-a6ba-c87b5da55977 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:30.446034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-39d1337d-e17f-4257-a6ba-c87b5da55977 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:30.453028 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-39d1337d-e17f-4257-a6ba-c87b5da55977 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:30.453689 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-39d1337d-e17f-4257-a6ba-c87b5da55977 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:30.454738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-39d1337d-e17f-4257-a6ba-c87b5da55977 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:30.455342 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-39d1337d-e17f-4257-a6ba-c87b5da55977 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:30.472244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-27bf6245-cff8-4703-8b60-cfa762c40c2c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:30.472801 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-27bf6245-cff8-4703-8b60-cfa762c40c2c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:30.479311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-27bf6245-cff8-4703-8b60-cfa762c40c2c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:30.480307 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-27bf6245-cff8-4703-8b60-cfa762c40c2c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:30.481070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-27bf6245-cff8-4703-8b60-cfa762c40c2c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:30.481545 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-27bf6245-cff8-4703-8b60-cfa762c40c2c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:30.497393 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:30.667067 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-39d1337d-e17f-4257-a6ba-c87b5da55977 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:30.670525 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-27bf6245-cff8-4703-8b60-cfa762c40c2c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:30.674529 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-39d1337d-e17f-4257-a6ba-c87b5da55977 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.233638 May 26 15:12:30.675099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 254/508] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:30 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:30.677996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-27bf6245-cff8-4703-8b60-cfa762c40c2c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1272 microversion: 2.1 time: 0.209867 May 26 15:12:30.678544 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 255/509] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:30 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:30.936231 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:12:30.936477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Thu May 26 15:12:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:12:31.691224 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-06c25ccd-5fa3-4f2d-8771-8823b1ed7aec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:31.691878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-06c25ccd-5fa3-4f2d-8771-8823b1ed7aec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:31.694540 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e11acf45-209c-4ac5-b5a4-94e9fc5ae281 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:31.695256 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e11acf45-209c-4ac5-b5a4-94e9fc5ae281 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:31.699023 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-06c25ccd-5fa3-4f2d-8771-8823b1ed7aec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:31.699479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-06c25ccd-5fa3-4f2d-8771-8823b1ed7aec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:31.700251 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-06c25ccd-5fa3-4f2d-8771-8823b1ed7aec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:31.700689 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-06c25ccd-5fa3-4f2d-8771-8823b1ed7aec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:31.702530 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e11acf45-209c-4ac5-b5a4-94e9fc5ae281 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:31.703095 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e11acf45-209c-4ac5-b5a4-94e9fc5ae281 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:31.703957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e11acf45-209c-4ac5-b5a4-94e9fc5ae281 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:31.705132 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e11acf45-209c-4ac5-b5a4-94e9fc5ae281 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:31.948323 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-06c25ccd-5fa3-4f2d-8771-8823b1ed7aec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:31.961586 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e11acf45-209c-4ac5-b5a4-94e9fc5ae281 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:31.963209 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-06c25ccd-5fa3-4f2d-8771-8823b1ed7aec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.275490 May 26 15:12:31.966582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 255/510] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:31 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:31.981937 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e11acf45-209c-4ac5-b5a4-94e9fc5ae281 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.290360 May 26 15:12:31.982604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 256/511] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:31 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:32.113620 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-1de77d67-bff0-43dd-b3a2-ed95ec67a9f8 req-bfc031b4-9428-4b0a-b613-e914f04b0d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a80f2c7-1451-47b7-9f5e-3d53c21794ae", "tag": "919581af-7ccb-4d91-b17b-36af6ce1ee96"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:32.123383 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-1de77d67-bff0-43dd-b3a2-ed95ec67a9f8 req-bfc031b4-9428-4b0a-b613-e914f04b0d67 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:32.123848 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-1de77d67-bff0-43dd-b3a2-ed95ec67a9f8 req-bfc031b4-9428-4b0a-b613-e914f04b0d67 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:32.137653 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-1de77d67-bff0-43dd-b3a2-ed95ec67a9f8 req-bfc031b4-9428-4b0a-b613-e914f04b0d67 service nova] Creating event network-changed:919581af-7ccb-4d91-b17b-36af6ce1ee96 for instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae on hv-cinder-78836 May 26 15:12:32.145410 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-1de77d67-bff0-43dd-b3a2-ed95ec67a9f8 req-bfc031b4-9428-4b0a-b613-e914f04b0d67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035780 May 26 15:12:32.146315 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 256/512] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:32.983114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-be06e667-f176-4448-bc3b-51516743b818 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:32.983745 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-be06e667-f176-4448-bc3b-51516743b818 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:32.985612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=8 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:32.986723 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:32.992324 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be06e667-f176-4448-bc3b-51516743b818 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:32.992779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be06e667-f176-4448-bc3b-51516743b818 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:32.993570 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be06e667-f176-4448-bc3b-51516743b818 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:32.994010 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be06e667-f176-4448-bc3b-51516743b818 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:32.996138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=4 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:32.996923 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=12 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:33.001558 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-26368df2-0e23-4724-bdfc-9d7191678317 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:33.002344 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-26368df2-0e23-4724-bdfc-9d7191678317 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:33.009567 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-26368df2-0e23-4724-bdfc-9d7191678317 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:33.010102 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-26368df2-0e23-4724-bdfc-9d7191678317 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:33.010873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-26368df2-0e23-4724-bdfc-9d7191678317 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:33.011314 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-26368df2-0e23-4724-bdfc-9d7191678317 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:33.192488 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-be06e667-f176-4448-bc3b-51516743b818 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:33.200978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-26368df2-0e23-4724-bdfc-9d7191678317 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:33.201462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-be06e667-f176-4448-bc3b-51516743b818 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.223025 May 26 15:12:33.202058 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 257/513] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:32 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:33.208743 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-26368df2-0e23-4724-bdfc-9d7191678317 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.213895 May 26 15:12:33.209294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 257/514] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:32 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:34.217848 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2fc36717-a173-4e3e-a6c8-8f9ef901cf00 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:34.218424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2fc36717-a173-4e3e-a6c8-8f9ef901cf00 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:34.224989 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2fc36717-a173-4e3e-a6c8-8f9ef901cf00 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:34.225472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2fc36717-a173-4e3e-a6c8-8f9ef901cf00 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:34.225595 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-41a9695a-1d4f-4a49-93bf-eefea2c20d58 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:34.226182 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-41a9695a-1d4f-4a49-93bf-eefea2c20d58 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:34.226296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2fc36717-a173-4e3e-a6c8-8f9ef901cf00 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:34.226685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2fc36717-a173-4e3e-a6c8-8f9ef901cf00 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:34.233266 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-41a9695a-1d4f-4a49-93bf-eefea2c20d58 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:34.233738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-41a9695a-1d4f-4a49-93bf-eefea2c20d58 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:34.234493 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-41a9695a-1d4f-4a49-93bf-eefea2c20d58 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:34.234931 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-41a9695a-1d4f-4a49-93bf-eefea2c20d58 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:34.423642 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2fc36717-a173-4e3e-a6c8-8f9ef901cf00 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:34.431174 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2fc36717-a173-4e3e-a6c8-8f9ef901cf00 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.217336 May 26 15:12:34.431751 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 258/515] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:34 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:34.431906 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-41a9695a-1d4f-4a49-93bf-eefea2c20d58 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:34.439883 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-41a9695a-1d4f-4a49-93bf-eefea2c20d58 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.218091 May 26 15:12:34.440437 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 258/516] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:34 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:35.448695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3a4d9e62-19e8-437e-b4f6-c5be90100f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:35.451135 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3a4d9e62-19e8-437e-b4f6-c5be90100f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:35.456102 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-24185abb-6e37-4ffe-9e68-4328de4d6482 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:35.456530 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a4d9e62-19e8-437e-b4f6-c5be90100f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:35.456760 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-24185abb-6e37-4ffe-9e68-4328de4d6482 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:35.456970 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a4d9e62-19e8-437e-b4f6-c5be90100f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:35.457768 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a4d9e62-19e8-437e-b4f6-c5be90100f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:35.458209 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a4d9e62-19e8-437e-b4f6-c5be90100f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:35.464164 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24185abb-6e37-4ffe-9e68-4328de4d6482 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:35.464616 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24185abb-6e37-4ffe-9e68-4328de4d6482 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:35.465380 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24185abb-6e37-4ffe-9e68-4328de4d6482 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:35.465858 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24185abb-6e37-4ffe-9e68-4328de4d6482 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:35.484031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:35.648190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3a4d9e62-19e8-437e-b4f6-c5be90100f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:35.657690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3a4d9e62-19e8-437e-b4f6-c5be90100f6b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.212676 May 26 15:12:35.658477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 259/517] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:35 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:35.672095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-24185abb-6e37-4ffe-9e68-4328de4d6482 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:35.680416 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-24185abb-6e37-4ffe-9e68-4328de4d6482 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.228083 May 26 15:12:35.681109 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 259/518] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:35 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:36.676654 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-711fed7e-d6e3-41f9-b8c6-fb109d0b121b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:36.677295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-711fed7e-d6e3-41f9-b8c6-fb109d0b121b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:36.684391 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-711fed7e-d6e3-41f9-b8c6-fb109d0b121b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:36.684844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-711fed7e-d6e3-41f9-b8c6-fb109d0b121b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:36.685639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-711fed7e-d6e3-41f9-b8c6-fb109d0b121b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:36.686078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-711fed7e-d6e3-41f9-b8c6-fb109d0b121b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:36.701829 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5f1d3f49-f7d3-4dd5-98a5-250ec447adec tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:36.702436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5f1d3f49-f7d3-4dd5-98a5-250ec447adec tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:36.708838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f1d3f49-f7d3-4dd5-98a5-250ec447adec tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:36.709281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f1d3f49-f7d3-4dd5-98a5-250ec447adec tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:36.710149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f1d3f49-f7d3-4dd5-98a5-250ec447adec tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:36.710616 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f1d3f49-f7d3-4dd5-98a5-250ec447adec tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:36.881086 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-711fed7e-d6e3-41f9-b8c6-fb109d0b121b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:36.889349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-711fed7e-d6e3-41f9-b8c6-fb109d0b121b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.216864 May 26 15:12:36.889840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5f1d3f49-f7d3-4dd5-98a5-250ec447adec tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:36.890008 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 260/519] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:36 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:36.897138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5f1d3f49-f7d3-4dd5-98a5-250ec447adec tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.199807 May 26 15:12:36.897725 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 260/520] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:36 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:37.794097 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-65c6be6a-2fbb-4f4e-bad8-f1c2d6d7cdec req-9bef31e4-5a48-4d34-9da8-6074301eb8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4682a8fb-1ed3-492f-963e-7befa1cf839d", "name": "network-vif-plugged", "status": "completed", "tag": "af1b1d4b-d86d-4d01-b349-f19b08f5f132"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:37.803289 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-65c6be6a-2fbb-4f4e-bad8-f1c2d6d7cdec req-9bef31e4-5a48-4d34-9da8-6074301eb8b6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:37.803737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-65c6be6a-2fbb-4f4e-bad8-f1c2d6d7cdec req-9bef31e4-5a48-4d34-9da8-6074301eb8b6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:37.815270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-65c6be6a-2fbb-4f4e-bad8-f1c2d6d7cdec req-9bef31e4-5a48-4d34-9da8-6074301eb8b6 service nova] Creating event network-vif-plugged:af1b1d4b-d86d-4d01-b349-f19b08f5f132 for instance 4682a8fb-1ed3-492f-963e-7befa1cf839d on hv-cinder-78836 May 26 15:12:37.820187 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-65c6be6a-2fbb-4f4e-bad8-f1c2d6d7cdec req-9bef31e4-5a48-4d34-9da8-6074301eb8b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030252 May 26 15:12:37.821020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 261/521] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:37.907299 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-29fe6201-c7fe-410d-bd76-d090ce2061da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:37.907835 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-29fe6201-c7fe-410d-bd76-d090ce2061da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:37.914221 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fe02bfc3-25ea-4e6f-8992-8eae01b3ef91 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:37.914393 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-29fe6201-c7fe-410d-bd76-d090ce2061da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:37.914768 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-29fe6201-c7fe-410d-bd76-d090ce2061da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:37.914946 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fe02bfc3-25ea-4e6f-8992-8eae01b3ef91 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:37.915529 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-29fe6201-c7fe-410d-bd76-d090ce2061da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:37.915966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-29fe6201-c7fe-410d-bd76-d090ce2061da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:37.921071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe02bfc3-25ea-4e6f-8992-8eae01b3ef91 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:37.921556 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe02bfc3-25ea-4e6f-8992-8eae01b3ef91 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:37.922328 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe02bfc3-25ea-4e6f-8992-8eae01b3ef91 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:37.922759 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe02bfc3-25ea-4e6f-8992-8eae01b3ef91 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:38.119862 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-29fe6201-c7fe-410d-bd76-d090ce2061da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:38.125637 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fe02bfc3-25ea-4e6f-8992-8eae01b3ef91 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:38.127994 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-29fe6201-c7fe-410d-bd76-d090ce2061da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.224708 May 26 15:12:38.128726 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 261/522] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:37 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:38.133643 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fe02bfc3-25ea-4e6f-8992-8eae01b3ef91 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.223633 May 26 15:12:38.134214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 262/523] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:37 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:39.145501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-cce6b818-71b4-42cc-98e7-356f22efe662 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:39.146126 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cce6b818-71b4-42cc-98e7-356f22efe662 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:39.150666 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-000ebf86-8268-4e7a-89f3-ef03f409c0e1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:39.151282 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-000ebf86-8268-4e7a-89f3-ef03f409c0e1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:39.153098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cce6b818-71b4-42cc-98e7-356f22efe662 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:39.153591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cce6b818-71b4-42cc-98e7-356f22efe662 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:39.154364 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cce6b818-71b4-42cc-98e7-356f22efe662 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:39.154811 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cce6b818-71b4-42cc-98e7-356f22efe662 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:39.157783 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-000ebf86-8268-4e7a-89f3-ef03f409c0e1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:39.158269 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-000ebf86-8268-4e7a-89f3-ef03f409c0e1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:39.159029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-000ebf86-8268-4e7a-89f3-ef03f409c0e1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:39.159466 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-000ebf86-8268-4e7a-89f3-ef03f409c0e1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:39.339301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-cce6b818-71b4-42cc-98e7-356f22efe662 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:39.347183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-cce6b818-71b4-42cc-98e7-356f22efe662 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.205561 May 26 15:12:39.347745 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 262/524] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:39 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:39.352893 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-000ebf86-8268-4e7a-89f3-ef03f409c0e1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:39.360256 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-000ebf86-8268-4e7a-89f3-ef03f409c0e1 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.213476 May 26 15:12:39.360802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 263/525] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:39 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:39.522059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-36181e8a-346c-41c2-9b3e-65bf4eceff21 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:39.522550 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-36181e8a-346c-41c2-9b3e-65bf4eceff21 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:39.528527 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36181e8a-346c-41c2-9b3e-65bf4eceff21 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:39.529044 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36181e8a-346c-41c2-9b3e-65bf4eceff21 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:39.529751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36181e8a-346c-41c2-9b3e-65bf4eceff21 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:39.530185 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36181e8a-346c-41c2-9b3e-65bf4eceff21 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:39.654410 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-36181e8a-346c-41c2-9b3e-65bf4eceff21 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lazy-loading 'services' on Instance uuid d60f535d-631c-4b12-97b0-d134f2042e1f {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:12:39.768677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-36181e8a-346c-41c2-9b3e-65bf4eceff21 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f/os-volume_attachments/632b160f-4c86-4ff0-aaf6-2e32f3641b77" status: 202 len: 0 microversion: 2.1 time: 0.250332 May 26 15:12:39.769256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 263/526] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:12:39 2022] DELETE /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f/os-volume_attachments/632b160f-4c86-4ff0-aaf6-2e32f3641b77 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:12:40.363817 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f789c5a7-0aaf-4b02-b1f8-70d93da84848 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:40.364422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f789c5a7-0aaf-4b02-b1f8-70d93da84848 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:40.371111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f789c5a7-0aaf-4b02-b1f8-70d93da84848 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:40.371638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f789c5a7-0aaf-4b02-b1f8-70d93da84848 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:40.372405 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f789c5a7-0aaf-4b02-b1f8-70d93da84848 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:40.372843 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f789c5a7-0aaf-4b02-b1f8-70d93da84848 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:40.377810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-98a8f012-ed41-4b90-92c0-f08cbeb039eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:40.378511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-98a8f012-ed41-4b90-92c0-f08cbeb039eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:40.384821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-98a8f012-ed41-4b90-92c0-f08cbeb039eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:40.385269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-98a8f012-ed41-4b90-92c0-f08cbeb039eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:40.386075 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-98a8f012-ed41-4b90-92c0-f08cbeb039eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:40.387029 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-98a8f012-ed41-4b90-92c0-f08cbeb039eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:40.567764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f789c5a7-0aaf-4b02-b1f8-70d93da84848 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:40.576921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f789c5a7-0aaf-4b02-b1f8-70d93da84848 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1371 microversion: 2.1 time: 0.216886 May 26 15:12:40.577527 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 264/527] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:40 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:40.581659 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-98a8f012-ed41-4b90-92c0-f08cbeb039eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:40.589469 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-98a8f012-ed41-4b90-92c0-f08cbeb039eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.216229 May 26 15:12:40.590024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 264/528] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:40 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:41.594258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3b7e7b5c-af7c-4b21-9a80-efc25965c83f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:41.594867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3b7e7b5c-af7c-4b21-9a80-efc25965c83f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:41.601305 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3b7e7b5c-af7c-4b21-9a80-efc25965c83f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:41.601817 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3b7e7b5c-af7c-4b21-9a80-efc25965c83f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:41.602572 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3b7e7b5c-af7c-4b21-9a80-efc25965c83f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:41.603003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3b7e7b5c-af7c-4b21-9a80-efc25965c83f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:41.605709 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8dbc18b0-b8d4-42fd-a0b9-1e4305ddffe2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:41.606321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8dbc18b0-b8d4-42fd-a0b9-1e4305ddffe2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:41.612788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8dbc18b0-b8d4-42fd-a0b9-1e4305ddffe2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:41.613385 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8dbc18b0-b8d4-42fd-a0b9-1e4305ddffe2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:41.614171 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8dbc18b0-b8d4-42fd-a0b9-1e4305ddffe2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:41.614604 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8dbc18b0-b8d4-42fd-a0b9-1e4305ddffe2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:41.806381 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3b7e7b5c-af7c-4b21-9a80-efc25965c83f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:41.809678 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8dbc18b0-b8d4-42fd-a0b9-1e4305ddffe2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:41.814071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3b7e7b5c-af7c-4b21-9a80-efc25965c83f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1565 microversion: 2.1 time: 0.224221 May 26 15:12:41.814647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 265/529] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:41 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:41.817084 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8dbc18b0-b8d4-42fd-a0b9-1e4305ddffe2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.215439 May 26 15:12:41.817657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 265/530] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:41 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:41.830374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0dafa76a-8e81-4896-a69a-986f602485a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:41.830858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0dafa76a-8e81-4896-a69a-986f602485a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:41.836660 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dafa76a-8e81-4896-a69a-986f602485a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:41.837104 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dafa76a-8e81-4896-a69a-986f602485a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:41.837892 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dafa76a-8e81-4896-a69a-986f602485a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:41.838325 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0dafa76a-8e81-4896-a69a-986f602485a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:41.917772 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0dafa76a-8e81-4896-a69a-986f602485a6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090895 May 26 15:12:41.918644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 266/531] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 15:12:41 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:12:42.834860 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6df6cf24-dcad-4fa4-808d-ea9d03f04f78 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:42.835475 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6df6cf24-dcad-4fa4-808d-ea9d03f04f78 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:42.845804 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6df6cf24-dcad-4fa4-808d-ea9d03f04f78 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:42.846255 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6df6cf24-dcad-4fa4-808d-ea9d03f04f78 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:42.847032 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6df6cf24-dcad-4fa4-808d-ea9d03f04f78 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:42.847461 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6df6cf24-dcad-4fa4-808d-ea9d03f04f78 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:42.990710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6df6cf24-dcad-4fa4-808d-ea9d03f04f78 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:43.000424 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6df6cf24-dcad-4fa4-808d-ea9d03f04f78 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.169432 May 26 15:12:43.001101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 266/532] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:42 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:43.073556 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-9e6ddd05-215d-4f9b-8536-61daf99cb15d req-d06ea7c1-7bc4-4fa1-aa90-f94d61f67279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4682a8fb-1ed3-492f-963e-7befa1cf839d", "tag": "af1b1d4b-d86d-4d01-b349-f19b08f5f132"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:43.083150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-9e6ddd05-215d-4f9b-8536-61daf99cb15d req-d06ea7c1-7bc4-4fa1-aa90-f94d61f67279 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:43.083889 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-9e6ddd05-215d-4f9b-8536-61daf99cb15d req-d06ea7c1-7bc4-4fa1-aa90-f94d61f67279 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:43.096903 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-9e6ddd05-215d-4f9b-8536-61daf99cb15d req-d06ea7c1-7bc4-4fa1-aa90-f94d61f67279 service nova] Creating event network-changed:af1b1d4b-d86d-4d01-b349-f19b08f5f132 for instance 4682a8fb-1ed3-492f-963e-7befa1cf839d on hv-cinder-78836 May 26 15:12:43.102016 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-9e6ddd05-215d-4f9b-8536-61daf99cb15d req-d06ea7c1-7bc4-4fa1-aa90-f94d61f67279 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032552 May 26 15:12:43.102701 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 267/533] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:44.017591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-2b5df76d-0e26-456b-bb82-d51c17904623 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:44.018414 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-2b5df76d-0e26-456b-bb82-d51c17904623 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:44.025489 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2b5df76d-0e26-456b-bb82-d51c17904623 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:44.026085 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2b5df76d-0e26-456b-bb82-d51c17904623 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:44.026963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2b5df76d-0e26-456b-bb82-d51c17904623 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:44.027650 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2b5df76d-0e26-456b-bb82-d51c17904623 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:44.071965 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4b471d61-28e0-43d6-90a7-611ce53c7f98 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:44.072570 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4b471d61-28e0-43d6-90a7-611ce53c7f98 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:44.079592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4b471d61-28e0-43d6-90a7-611ce53c7f98 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:44.080204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4b471d61-28e0-43d6-90a7-611ce53c7f98 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:44.080823 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4b471d61-28e0-43d6-90a7-611ce53c7f98 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:44.081265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4b471d61-28e0-43d6-90a7-611ce53c7f98 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:44.107403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4b471d61-28e0-43d6-90a7-611ce53c7f98 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:12:44.185313 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-2b5df76d-0e26-456b-bb82-d51c17904623 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:44.194199 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4b471d61-28e0-43d6-90a7-611ce53c7f98 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 204 len: 0 microversion: 2.1 time: 0.127341 May 26 15:12:44.194583 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-2b5df76d-0e26-456b-bb82-d51c17904623 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.181234 May 26 15:12:44.195167 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 268/534] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:12:44 2022] DELETE /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:12:44.203710 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4764b8ca-2520-4583-8ed5-e8b3a9f53696 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:44.205545 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 267/535] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:44 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:44.206097 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4764b8ca-2520-4583-8ed5-e8b3a9f53696 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:44.213870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4764b8ca-2520-4583-8ed5-e8b3a9f53696 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:44.214904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4764b8ca-2520-4583-8ed5-e8b3a9f53696 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:44.215697 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4764b8ca-2520-4583-8ed5-e8b3a9f53696 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:44.216139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4764b8ca-2520-4583-8ed5-e8b3a9f53696 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:44.362677 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4764b8ca-2520-4583-8ed5-e8b3a9f53696 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:44.370721 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4764b8ca-2520-4583-8ed5-e8b3a9f53696 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1515 microversion: 2.1 time: 0.171074 May 26 15:12:44.371328 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 269/536] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:44 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:45.212021 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3c51946d-d4ae-426b-8e2b-60668f14a35b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:45.212638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3c51946d-d4ae-426b-8e2b-60668f14a35b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:45.219607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c51946d-d4ae-426b-8e2b-60668f14a35b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:45.220062 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c51946d-d4ae-426b-8e2b-60668f14a35b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:45.220825 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c51946d-d4ae-426b-8e2b-60668f14a35b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:45.221266 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c51946d-d4ae-426b-8e2b-60668f14a35b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:45.360836 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3c51946d-d4ae-426b-8e2b-60668f14a35b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:45.368215 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3c51946d-d4ae-426b-8e2b-60668f14a35b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.160199 May 26 15:12:45.368777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 268/537] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:45 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:45.388392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-dbe51e95-71a5-4200-a894-73a6d8229430 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:45.389389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-dbe51e95-71a5-4200-a894-73a6d8229430 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:45.396151 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbe51e95-71a5-4200-a894-73a6d8229430 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:45.396700 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbe51e95-71a5-4200-a894-73a6d8229430 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:45.397631 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbe51e95-71a5-4200-a894-73a6d8229430 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:45.398266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dbe51e95-71a5-4200-a894-73a6d8229430 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:45.532243 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-dbe51e95-71a5-4200-a894-73a6d8229430 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:45.539787 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-dbe51e95-71a5-4200-a894-73a6d8229430 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1515 microversion: 2.1 time: 0.155752 May 26 15:12:45.540353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 270/538] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:45 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:45.956927 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-dd7d5352-f4be-49bf-9699-72a0cd2eb5c0 req-c4c39ae2-d492-4971-b08a-cdfd330b35e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a80f2c7-1451-47b7-9f5e-3d53c21794ae", "name": "network-vif-plugged", "status": "completed", "tag": "919581af-7ccb-4d91-b17b-36af6ce1ee96"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:45.967724 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-dd7d5352-f4be-49bf-9699-72a0cd2eb5c0 req-c4c39ae2-d492-4971-b08a-cdfd330b35e6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:45.968185 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-dd7d5352-f4be-49bf-9699-72a0cd2eb5c0 req-c4c39ae2-d492-4971-b08a-cdfd330b35e6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:45.979711 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-dd7d5352-f4be-49bf-9699-72a0cd2eb5c0 req-c4c39ae2-d492-4971-b08a-cdfd330b35e6 service nova] Creating event network-vif-plugged:919581af-7ccb-4d91-b17b-36af6ce1ee96 for instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae on hv-cinder-78836 May 26 15:12:45.984555 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-dd7d5352-f4be-49bf-9699-72a0cd2eb5c0 req-c4c39ae2-d492-4971-b08a-cdfd330b35e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031254 May 26 15:12:45.985321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 269/539] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:46.384581 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-95a58f73-3244-48c1-815d-662ad664dcfd tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:46.385171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-95a58f73-3244-48c1-815d-662ad664dcfd tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:46.391687 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95a58f73-3244-48c1-815d-662ad664dcfd tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:46.392283 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95a58f73-3244-48c1-815d-662ad664dcfd tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:46.392871 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95a58f73-3244-48c1-815d-662ad664dcfd tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:46.393306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-95a58f73-3244-48c1-815d-662ad664dcfd tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:46.531952 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-95a58f73-3244-48c1-815d-662ad664dcfd tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:46.539928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-95a58f73-3244-48c1-815d-662ad664dcfd tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.159216 May 26 15:12:46.540499 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 271/540] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:46 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:46.557242 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d9058099-a62e-4515-9401-4e093a80227a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:46.557978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d9058099-a62e-4515-9401-4e093a80227a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:46.564644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d9058099-a62e-4515-9401-4e093a80227a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:46.565095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d9058099-a62e-4515-9401-4e093a80227a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:46.565895 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d9058099-a62e-4515-9401-4e093a80227a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:46.566330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d9058099-a62e-4515-9401-4e093a80227a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:46.740925 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d9058099-a62e-4515-9401-4e093a80227a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:46.749181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d9058099-a62e-4515-9401-4e093a80227a tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1515 microversion: 2.1 time: 0.196836 May 26 15:12:46.749779 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 270/541] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:46 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:47.557778 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7440ac10-37e1-410e-862a-0d089a90a9a9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:47.558406 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7440ac10-37e1-410e-862a-0d089a90a9a9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:47.565132 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7440ac10-37e1-410e-862a-0d089a90a9a9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:47.565647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7440ac10-37e1-410e-862a-0d089a90a9a9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:47.566422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7440ac10-37e1-410e-862a-0d089a90a9a9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:47.566863 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7440ac10-37e1-410e-862a-0d089a90a9a9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:47.569670 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:47.613630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-e07874e4-1ccb-4e7f-874b-4b0cfd269401 req-b422a396-b20e-413a-85fa-3efe5f92c5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f535d-631c-4b12-97b0-d134f2042e1f", "name": "network-vif-deleted", "tag": "930ee718-30cf-4a82-92d1-09e4d1723a9e"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:47.622823 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-e07874e4-1ccb-4e7f-874b-4b0cfd269401 req-b422a396-b20e-413a-85fa-3efe5f92c5b0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:47.623262 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-e07874e4-1ccb-4e7f-874b-4b0cfd269401 req-b422a396-b20e-413a-85fa-3efe5f92c5b0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:47.635429 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-e07874e4-1ccb-4e7f-874b-4b0cfd269401 req-b422a396-b20e-413a-85fa-3efe5f92c5b0 service nova] Creating event network-vif-deleted:930ee718-30cf-4a82-92d1-09e4d1723a9e for instance d60f535d-631c-4b12-97b0-d134f2042e1f on hv-cinder-78836 May 26 15:12:47.640750 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-e07874e4-1ccb-4e7f-874b-4b0cfd269401 req-b422a396-b20e-413a-85fa-3efe5f92c5b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030778 May 26 15:12:47.641351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 271/542] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:47.721964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7440ac10-37e1-410e-862a-0d089a90a9a9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:47.729849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7440ac10-37e1-410e-862a-0d089a90a9a9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1260 microversion: 2.1 time: 0.177468 May 26 15:12:47.730442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 272/543] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:47 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:47.766887 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-83a3097f-bc75-4f6a-b6de-9fe331054b86 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:47.767589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-83a3097f-bc75-4f6a-b6de-9fe331054b86 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:47.774015 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-83a3097f-bc75-4f6a-b6de-9fe331054b86 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:47.774466 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-83a3097f-bc75-4f6a-b6de-9fe331054b86 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:47.775233 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-83a3097f-bc75-4f6a-b6de-9fe331054b86 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:47.775731 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-83a3097f-bc75-4f6a-b6de-9fe331054b86 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:47.842776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-83a3097f-bc75-4f6a-b6de-9fe331054b86 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:47.850271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-83a3097f-bc75-4f6a-b6de-9fe331054b86 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1304 microversion: 2.1 time: 0.088318 May 26 15:12:47.850841 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 272/544] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:47 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:48.747119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7caeba1b-0143-441f-9495-c116a34b6342 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:48.747731 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7caeba1b-0143-441f-9495-c116a34b6342 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:48.754311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7caeba1b-0143-441f-9495-c116a34b6342 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:48.754760 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7caeba1b-0143-441f-9495-c116a34b6342 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:48.755578 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7caeba1b-0143-441f-9495-c116a34b6342 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:48.756013 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7caeba1b-0143-441f-9495-c116a34b6342 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:48.867631 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:48.868249 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:48.871106 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:48.877298 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:48.877714 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:48.878487 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:48.878944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:48.890215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7caeba1b-0143-441f-9495-c116a34b6342 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:48.897772 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7caeba1b-0143-441f-9495-c116a34b6342 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1444 microversion: 2.1 time: 0.154717 May 26 15:12:48.898347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 273/545] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:48 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:48.910871 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:48.911244 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:48.911696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lazy-loading 'fault' on Instance uuid d60f535d-631c-4b12-97b0-d134f2042e1f {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:12:48.914398 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8c129904-d433-4896-8a6c-cf7381c1375c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:48.915139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8c129904-d433-4896-8a6c-cf7381c1375c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:48.921714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c129904-d433-4896-8a6c-cf7381c1375c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:48.922168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c129904-d433-4896-8a6c-cf7381c1375c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:48.922930 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c129904-d433-4896-8a6c-cf7381c1375c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:48.923370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c129904-d433-4896-8a6c-cf7381c1375c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:48.958322 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:48.968525 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a897992c-8832-4ecf-9ad4-0b1381956787 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 200 len: 1309 microversion: 2.1 time: 0.104618 May 26 15:12:48.969555 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 273/546] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:48 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:49.053727 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8c129904-d433-4896-8a6c-cf7381c1375c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:49.061782 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8c129904-d433-4896-8a6c-cf7381c1375c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1444 microversion: 2.1 time: 0.151081 May 26 15:12:49.062356 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 274/547] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:48 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:49.997497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:50.000243 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: d60f535d-631c-4b12-97b0-d134f2042e1f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:50.006708 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:50.007347 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:50.008132 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:50.008567 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:50.022464 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] HTTP exception thrown: Instance d60f535d-631c-4b12-97b0-d134f2042e1f could not be found. May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Request method failure captured: May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f HTTP/1.1 May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5iWABEljxZ37wEbIvSQifrgnX-v5bM4fZenZcmDNgal59l0pDKFz7IvVOMOYHDfSEs-DN-INcgKEaZ0BO2yfY2mdnwgG0MuhQZde-C2Sl-pz2oTw_EE8Op3skgFh_ZYv7infXNIEHaLKk-ZzX-BJvHaxxoRaE-Xo0UyGtMdKIPXSjk May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: d58410e922bd46418c9e93bf61b348f8 May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesSnapshotTestJSON-505900774 May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:12:50.024438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d58410e922bd46418c9e93bf61b348f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d58410e922bd46418c9e93bf61b348f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d58410e922bd46418c9e93bf61b348f8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d58410e922bd46418c9e93bf61b348f8"}]}] May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesSnapshotTestJSON-505900774 May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: d58410e922bd46418c9e93bf61b348f8 May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-505900774 May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesSnapshotTestJSON-505900774-project May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: dfa425e42202421c9e1c8564456c67f7 May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesSnapshotTestJSON-505900774-project May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance d60f535d-631c-4b12-97b0-d134f2042e1f could not be found. May 26 15:12:50.025843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': 'd60f535d-631c-4b12-97b0-d134f2042e1f'} May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60f535d-631c-4b12-97b0-d134f2042e1f could not be found. May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:12:50.026606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60f535d-631c-4b12-97b0-d134f2042e1f could not be found. May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60f535d-631c-4b12-97b0-d134f2042e1f could not be found. May 26 15:12:50.027904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:50.030219 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Returning 404 to user: Instance d60f535d-631c-4b12-97b0-d134f2042e1f could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:12:50.031659 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0f9c5cef-d212-4851-b0c7-4928bc51737c tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f" status: 404 len: 111 microversion: 2.1 time: 0.049557 May 26 15:12:50.032290 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 274/548] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:49 2022] GET /compute/v2.1/servers/d60f535d-631c-4b12-97b0-d134f2042e1f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:12:50.464298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9094797c-55d1-4c49-b24a-dffa6f66be58 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:50.464894 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9094797c-55d1-4c49-b24a-dffa6f66be58 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:50.471887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9094797c-55d1-4c49-b24a-dffa6f66be58 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:50.472351 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9094797c-55d1-4c49-b24a-dffa6f66be58 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:50.473110 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9094797c-55d1-4c49-b24a-dffa6f66be58 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:50.473585 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9094797c-55d1-4c49-b24a-dffa6f66be58 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:50.598592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-9094797c-55d1-4c49-b24a-dffa6f66be58 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lazy-loading 'services' on Instance uuid dea4ff4a-0c29-465d-b388-d223fd508a69 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:12:50.710569 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9094797c-55d1-4c49-b24a-dffa6f66be58 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/os-volume_attachments/8caa24e3-87ca-4343-bb1b-27cb0a4b2f60" status: 202 len: 0 microversion: 2.1 time: 0.250131 May 26 15:12:50.711255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 275/549] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:12:50 2022] DELETE /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/os-volume_attachments/8caa24e3-87ca-4343-bb1b-27cb0a4b2f60 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:12:50.840751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-7bd37e95-8c9d-4fa5-a9f0-e4d05d216d41 req-c2b3e9fa-1a3b-4d8f-82aa-25a946b5bac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a80f2c7-1451-47b7-9f5e-3d53c21794ae", "tag": "919581af-7ccb-4d91-b17b-36af6ce1ee96"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:50.849666 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-7bd37e95-8c9d-4fa5-a9f0-e4d05d216d41 req-c2b3e9fa-1a3b-4d8f-82aa-25a946b5bac3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:50.850076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-7bd37e95-8c9d-4fa5-a9f0-e4d05d216d41 req-c2b3e9fa-1a3b-4d8f-82aa-25a946b5bac3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:50.861224 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-7bd37e95-8c9d-4fa5-a9f0-e4d05d216d41 req-c2b3e9fa-1a3b-4d8f-82aa-25a946b5bac3 service nova] Creating event network-changed:919581af-7ccb-4d91-b17b-36af6ce1ee96 for instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae on hv-cinder-78836 May 26 15:12:50.866267 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-7bd37e95-8c9d-4fa5-a9f0-e4d05d216d41 req-c2b3e9fa-1a3b-4d8f-82aa-25a946b5bac3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029103 May 26 15:12:50.866877 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 275/550] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:56.052899 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e81b5ee3-b06b-404e-b7f6-ebf50957bcd7 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:56.059543 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e81b5ee3-b06b-404e-b7f6-ebf50957bcd7 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:56.059997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e81b5ee3-b06b-404e-b7f6-ebf50957bcd7 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:56.085250 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e81b5ee3-b06b-404e-b7f6-ebf50957bcd7 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Going to try to stop instance {{(pid=117723) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 15:12:56.127785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e81b5ee3-b06b-404e-b7f6-ebf50957bcd7 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/action" status: 202 len: 0 microversion: 2.1 time: 0.079574 May 26 15:12:56.128387 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 276/551] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:12:56 2022] POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:12:56.137673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-cf809c6e-1a47-434e-9b7e-8b8a3de6efcb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:56.138385 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cf809c6e-1a47-434e-9b7e-8b8a3de6efcb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:56.145916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cf809c6e-1a47-434e-9b7e-8b8a3de6efcb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:56.146417 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cf809c6e-1a47-434e-9b7e-8b8a3de6efcb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:56.147326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cf809c6e-1a47-434e-9b7e-8b8a3de6efcb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:56.147979 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cf809c6e-1a47-434e-9b7e-8b8a3de6efcb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:56.282816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-cf809c6e-1a47-434e-9b7e-8b8a3de6efcb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:56.290539 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-cf809c6e-1a47-434e-9b7e-8b8a3de6efcb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.157779 May 26 15:12:56.291102 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 276/552] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:56 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:57.309256 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-30ec54a3-fe31-4f78-beb7-12d1c1b4834e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:57.309983 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-30ec54a3-fe31-4f78-beb7-12d1c1b4834e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:57.316819 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30ec54a3-fe31-4f78-beb7-12d1c1b4834e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:57.317267 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30ec54a3-fe31-4f78-beb7-12d1c1b4834e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:57.318122 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30ec54a3-fe31-4f78-beb7-12d1c1b4834e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:57.318558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-30ec54a3-fe31-4f78-beb7-12d1c1b4834e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:57.446356 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-30ec54a3-fe31-4f78-beb7-12d1c1b4834e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:57.453810 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-30ec54a3-fe31-4f78-beb7-12d1c1b4834e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.149322 May 26 15:12:57.454378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 277/553] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:57 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:58.473361 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-842a32de-39d8-4193-9aec-22585b766577 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:58.474160 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-842a32de-39d8-4193-9aec-22585b766577 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:58.480984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-842a32de-39d8-4193-9aec-22585b766577 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.481431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-842a32de-39d8-4193-9aec-22585b766577 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.482212 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-842a32de-39d8-4193-9aec-22585b766577 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.482648 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-842a32de-39d8-4193-9aec-22585b766577 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.613833 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-842a32de-39d8-4193-9aec-22585b766577 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:58.618419 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:12:58.625688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-842a32de-39d8-4193-9aec-22585b766577 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.156132 May 26 15:12:58.626466 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 277/554] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:58 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:58.852255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b0b20d32-482d-4d36-aefa-f621fdc1e35e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:58.852804 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b0b20d32-482d-4d36-aefa-f621fdc1e35e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:58.859886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b0b20d32-482d-4d36-aefa-f621fdc1e35e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.860346 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b0b20d32-482d-4d36-aefa-f621fdc1e35e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.861119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b0b20d32-482d-4d36-aefa-f621fdc1e35e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.861588 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b0b20d32-482d-4d36-aefa-f621fdc1e35e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.878269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-235c90f5-bd73-4bf0-9b6b-15eeb8ef7d39 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:58.879019 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-235c90f5-bd73-4bf0-9b6b-15eeb8ef7d39 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:58.885992 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-235c90f5-bd73-4bf0-9b6b-15eeb8ef7d39 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.886488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-235c90f5-bd73-4bf0-9b6b-15eeb8ef7d39 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.887297 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-235c90f5-bd73-4bf0-9b6b-15eeb8ef7d39 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.887736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-235c90f5-bd73-4bf0-9b6b-15eeb8ef7d39 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.892089 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b0b20d32-482d-4d36-aefa-f621fdc1e35e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments/e87c1777-b08c-4554-ba93-e391e0c8bfd6" status: 200 len: 194 microversion: 2.20 time: 0.043885 May 26 15:12:58.892706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 278/555] 10.222.0.46 () {60 vars in 1453 bytes} [Thu May 26 15:12:58 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments/e87c1777-b08c-4554-ba93-e391e0c8bfd6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:12:58.901652 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1710684063", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "networks": [{"uuid": "e5c3a41d-5502-412d-93bc-4ee7162401e0"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:58.916219 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-235c90f5-bd73-4bf0-9b6b-15eeb8ef7d39 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f/ips" status: 200 len: 151 microversion: 2.1 time: 0.042279 May 26 15:12:58.916963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 278/556] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:12:58 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:12:58.929694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5d7a372-93b8-41b0-aed0-fecd493e3e19"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:12:58.930838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:58.937615 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.938082 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.939013 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:58.939317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:58.967662 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] validate_networks() for [('e5c3a41d-5502-412d-93bc-4ee7162401e0', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:12:59.021316 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Invalid volume: volume d5d7a372-93b8-41b0-aed0-fecd493e3e19 is already attached to instances: 957f4d2d-884d-44ff-9aee-1acf1b6c8959 May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: POST /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f/os-volume_attachments HTTP/1.1 May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 74 May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:12:59.023280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {"volumeAttachment": {"volumeId": "d5d7a372-93b8-41b0-aed0-fecd493e3e19"}} May 26 15:12:59.024694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Invalid volume: volume d5d7a372-93b8-41b0-aed0-fecd493e3e19 is already attached to instances: 957f4d2d-884d-44ff-9aee-1acf1b6c8959 May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'server_id': '9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f', 'body': {'volumeAttachment': {'volumeId': 'd5d7a372-93b8-41b0-aed0-fecd493e3e19'}}} May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d5d7a372-93b8-41b0-aed0-fecd493e3e19 is already attached to instances: 957f4d2d-884d-44ff-9aee-1acf1b6c8959 May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:59.025739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d5d7a372-93b8-41b0-aed0-fecd493e3e19 is already attached to instances: 957f4d2d-884d-44ff-9aee-1acf1b6c8959 May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:12:59.026958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:12:59.028317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:12:59.028317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:12:59.028317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:12:59.028317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d5d7a372-93b8-41b0-aed0-fecd493e3e19 is already attached to instances: 957f4d2d-884d-44ff-9aee-1acf1b6c8959 May 26 15:12:59.028317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:12:59.028317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 400 to user: Invalid volume: volume d5d7a372-93b8-41b0-aed0-fecd493e3e19 is already attached to instances: 957f4d2d-884d-44ff-9aee-1acf1b6c8959 {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:12:59.028317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-eeb974c8-c838-4cac-8183-67c5d6480fab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100080 May 26 15:12:59.028317 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 279/557] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:12:58 2022] POST /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:12:59.030950 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3f1f38a7-3796-49d5-9ac0-ddfbc1f2c038 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:59.031483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3f1f38a7-3796-49d5-9ac0-ddfbc1f2c038 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:59.038411 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3f1f38a7-3796-49d5-9ac0-ddfbc1f2c038 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.038860 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3f1f38a7-3796-49d5-9ac0-ddfbc1f2c038 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.039627 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3f1f38a7-3796-49d5-9ac0-ddfbc1f2c038 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.040066 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3f1f38a7-3796-49d5-9ac0-ddfbc1f2c038 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.124716 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-3f1f38a7-3796-49d5-9ac0-ddfbc1f2c038 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lazy-loading 'services' on Instance uuid 06cf01b4-e458-498b-990e-33b4171e1a14 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:12:59.198977 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3f1f38a7-3796-49d5-9ac0-ddfbc1f2c038 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "DELETE /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments/e87c1777-b08c-4554-ba93-e391e0c8bfd6" status: 202 len: 0 microversion: 2.20 time: 0.172493 May 26 15:12:59.199764 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 280/558] 10.222.0.46 () {60 vars in 1456 bytes} [Thu May 26 15:12:59 2022] DELETE /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments/e87c1777-b08c-4554-ba93-e391e0c8bfd6 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:12:59.204649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7ee0e9cf-4d1a-4d89-8c00-3cb587de5a59 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:59.205247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7ee0e9cf-4d1a-4d89-8c00-3cb587de5a59 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:59.212307 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ee0e9cf-4d1a-4d89-8c00-3cb587de5a59 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.212755 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ee0e9cf-4d1a-4d89-8c00-3cb587de5a59 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.213593 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ee0e9cf-4d1a-4d89-8c00-3cb587de5a59 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.214100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ee0e9cf-4d1a-4d89-8c00-3cb587de5a59 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.243375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7ee0e9cf-4d1a-4d89-8c00-3cb587de5a59 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:12:59.332149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7ee0e9cf-4d1a-4d89-8c00-3cb587de5a59 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 204 len: 0 microversion: 2.1 time: 0.130060 May 26 15:12:59.332946 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 281/559] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:12:59 2022] DELETE /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:12:59.337475 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:12:59.338195 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:12:59.338396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1403ff8a-a543-4d57-8c63-b6ffb2bce02c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:59.338782 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:12:59.339194 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:12:59.339460 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1403ff8a-a543-4d57-8c63-b6ffb2bce02c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:59.339603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:12:59.346451 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1403ff8a-a543-4d57-8c63-b6ffb2bce02c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.346957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1403ff8a-a543-4d57-8c63-b6ffb2bce02c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.347843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1403ff8a-a543-4d57-8c63-b6ffb2bce02c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.348246 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1403ff8a-a543-4d57-8c63-b6ffb2bce02c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.352520 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.354996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.355810 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.356247 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.375361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Getting quotas for project d58410e922bd46418c9e93bf61b348f8. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:12:59.379596 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Getting quotas for user dfa425e42202421c9e1c8564456c67f7 and project d58410e922bd46418c9e93bf61b348f8. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:12:59.381898 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1403ff8a-a543-4d57-8c63-b6ffb2bce02c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047870 May 26 15:12:59.382496 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 282/560] 10.222.0.46 () {60 vars in 1342 bytes} [Thu May 26 15:12:59 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:12:59.386969 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6dba3324-4c23-4263-9611-efad76046ab3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:59.387564 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6dba3324-4c23-4263-9611-efad76046ab3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:59.391128 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:12:59.393431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:12:59.393582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6dba3324-4c23-4263-9611-efad76046ab3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.394017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6dba3324-4c23-4263-9611-efad76046ab3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.394901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6dba3324-4c23-4263-9611-efad76046ab3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.395333 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6dba3324-4c23-4263-9611-efad76046ab3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.441108 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6f662e4c-d549-47f6-a361-c7742f059c01 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544940 May 26 15:12:59.446660 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 279/561] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:12:59.451685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d38bcbe8-c249-46a9-b4f3-9ea5c3c15205 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:59.452311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d38bcbe8-c249-46a9-b4f3-9ea5c3c15205 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:59.530438 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d38bcbe8-c249-46a9-b4f3-9ea5c3c15205 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:59.538970 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d38bcbe8-c249-46a9-b4f3-9ea5c3c15205 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1219 microversion: 2.1 time: 0.091128 May 26 15:12:59.539651 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 280/562] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:59 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:12:59.560665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6dba3324-4c23-4263-9611-efad76046ab3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:59.568482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6dba3324-4c23-4263-9611-efad76046ab3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1682 microversion: 2.1 time: 0.185040 May 26 15:12:59.569051 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 283/563] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:59 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:12:59.644460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-be4d0da2-ef30-4cba-92e9-c249aff8ecc1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:12:59.645122 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-be4d0da2-ef30-4cba-92e9-c249aff8ecc1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:12:59.651492 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be4d0da2-ef30-4cba-92e9-c249aff8ecc1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.652018 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be4d0da2-ef30-4cba-92e9-c249aff8ecc1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.652878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be4d0da2-ef30-4cba-92e9-c249aff8ecc1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:12:59.653392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-be4d0da2-ef30-4cba-92e9-c249aff8ecc1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:12:59.790812 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-be4d0da2-ef30-4cba-92e9-c249aff8ecc1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:12:59.799409 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-be4d0da2-ef30-4cba-92e9-c249aff8ecc1 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.158946 May 26 15:12:59.800020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 281/564] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:12:59 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:00.394794 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1a94c937-bb49-4d93-a56a-dc8acf85f29b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:00.395715 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1a94c937-bb49-4d93-a56a-dc8acf85f29b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:00.401916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a94c937-bb49-4d93-a56a-dc8acf85f29b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.402359 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a94c937-bb49-4d93-a56a-dc8acf85f29b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.403116 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a94c937-bb49-4d93-a56a-dc8acf85f29b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.403552 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a94c937-bb49-4d93-a56a-dc8acf85f29b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.432480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1a94c937-bb49-4d93-a56a-dc8acf85f29b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041620 May 26 15:13:00.433034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 284/565] 10.222.0.46 () {60 vars in 1342 bytes} [Thu May 26 15:13:00 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:13:00.555960 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-89b607e4-fa0a-4038-92cd-a478f868c70d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:00.556569 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-89b607e4-fa0a-4038-92cd-a478f868c70d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:00.564528 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89b607e4-fa0a-4038-92cd-a478f868c70d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.564985 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89b607e4-fa0a-4038-92cd-a478f868c70d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.565829 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89b607e4-fa0a-4038-92cd-a478f868c70d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.566267 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89b607e4-fa0a-4038-92cd-a478f868c70d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.587529 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3c14e22a-e28b-45be-925a-6ce4974a7cbf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:00.588128 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3c14e22a-e28b-45be-925a-6ce4974a7cbf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:00.595287 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c14e22a-e28b-45be-925a-6ce4974a7cbf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.595736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c14e22a-e28b-45be-925a-6ce4974a7cbf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.596489 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c14e22a-e28b-45be-925a-6ce4974a7cbf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.596920 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c14e22a-e28b-45be-925a-6ce4974a7cbf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.631102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-89b607e4-fa0a-4038-92cd-a478f868c70d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:00.638877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-89b607e4-fa0a-4038-92cd-a478f868c70d tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1223 microversion: 2.1 time: 0.086796 May 26 15:13:00.639452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 282/566] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:00 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:00.734916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3c14e22a-e28b-45be-925a-6ce4974a7cbf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:00.742363 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3c14e22a-e28b-45be-925a-6ce4974a7cbf tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1682 microversion: 2.1 time: 0.159599 May 26 15:13:00.742928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 285/567] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:00 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:00.817095 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fedb55a9-e8c0-480e-8259-35f9d5157ecf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:00.817691 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fedb55a9-e8c0-480e-8259-35f9d5157ecf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:00.823861 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fedb55a9-e8c0-480e-8259-35f9d5157ecf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.824318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fedb55a9-e8c0-480e-8259-35f9d5157ecf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.825079 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fedb55a9-e8c0-480e-8259-35f9d5157ecf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:00.825550 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fedb55a9-e8c0-480e-8259-35f9d5157ecf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:00.956152 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fedb55a9-e8c0-480e-8259-35f9d5157ecf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:00.963713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fedb55a9-e8c0-480e-8259-35f9d5157ecf tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.150463 May 26 15:13:00.964271 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 283/568] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:00 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:01.445049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-69d75277-c715-4270-9e18-ef3deba6d3aa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:01.446069 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-69d75277-c715-4270-9e18-ef3deba6d3aa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:01.452744 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-69d75277-c715-4270-9e18-ef3deba6d3aa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.453194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-69d75277-c715-4270-9e18-ef3deba6d3aa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.453982 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-69d75277-c715-4270-9e18-ef3deba6d3aa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.454416 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-69d75277-c715-4270-9e18-ef3deba6d3aa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.485517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-69d75277-c715-4270-9e18-ef3deba6d3aa tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044432 May 26 15:13:01.486298 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 286/569] 10.222.0.46 () {60 vars in 1342 bytes} [Thu May 26 15:13:01 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:13:01.655984 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5712fdec-de35-431f-bbf1-b9f6dcf9340e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:01.656508 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5712fdec-de35-431f-bbf1-b9f6dcf9340e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:01.663528 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5712fdec-de35-431f-bbf1-b9f6dcf9340e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.663980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5712fdec-de35-431f-bbf1-b9f6dcf9340e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.664734 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5712fdec-de35-431f-bbf1-b9f6dcf9340e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.665164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5712fdec-de35-431f-bbf1-b9f6dcf9340e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.755633 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5712fdec-de35-431f-bbf1-b9f6dcf9340e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:01.759857 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3054cf15-d056-4c22-8c50-4452957d2077 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:01.761923 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3054cf15-d056-4c22-8c50-4452957d2077 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:01.764100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5712fdec-de35-431f-bbf1-b9f6dcf9340e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1215 microversion: 2.1 time: 0.111872 May 26 15:13:01.765043 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 284/570] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:01 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:01.768807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3054cf15-d056-4c22-8c50-4452957d2077 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.769349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3054cf15-d056-4c22-8c50-4452957d2077 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.770255 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3054cf15-d056-4c22-8c50-4452957d2077 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.770684 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3054cf15-d056-4c22-8c50-4452957d2077 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.981603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-29716b4e-95cb-4aba-9de6-3397ff7f8526 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:01.982225 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-29716b4e-95cb-4aba-9de6-3397ff7f8526 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:01.988687 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-29716b4e-95cb-4aba-9de6-3397ff7f8526 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.989145 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-29716b4e-95cb-4aba-9de6-3397ff7f8526 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:01.989945 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-29716b4e-95cb-4aba-9de6-3397ff7f8526 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:01.990390 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-29716b4e-95cb-4aba-9de6-3397ff7f8526 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.059796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3054cf15-d056-4c22-8c50-4452957d2077 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:02.068592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3054cf15-d056-4c22-8c50-4452957d2077 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1682 microversion: 2.1 time: 0.312578 May 26 15:13:02.069271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 287/571] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:01 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1682 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:02.322889 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-29716b4e-95cb-4aba-9de6-3397ff7f8526 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:02.333730 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-29716b4e-95cb-4aba-9de6-3397ff7f8526 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.355783 May 26 15:13:02.334785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 285/572] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:01 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:02.499529 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-45de6bee-65eb-4f06-8a0a-018757b7df70 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:02.501058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-45de6bee-65eb-4f06-8a0a-018757b7df70 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:02.510196 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45de6bee-65eb-4f06-8a0a-018757b7df70 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.510903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45de6bee-65eb-4f06-8a0a-018757b7df70 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.511868 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45de6bee-65eb-4f06-8a0a-018757b7df70 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.512771 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45de6bee-65eb-4f06-8a0a-018757b7df70 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.554739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-45de6bee-65eb-4f06-8a0a-018757b7df70 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061214 May 26 15:13:02.555506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 288/573] 10.222.0.46 () {60 vars in 1342 bytes} [Thu May 26 15:13:02 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:02.640915 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-24e71c78-0d88-4b4f-bd88-adb2e668428e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:02.641587 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-24e71c78-0d88-4b4f-bd88-adb2e668428e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:02.648778 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24e71c78-0d88-4b4f-bd88-adb2e668428e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.649325 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24e71c78-0d88-4b4f-bd88-adb2e668428e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.650202 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24e71c78-0d88-4b4f-bd88-adb2e668428e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.650735 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24e71c78-0d88-4b4f-bd88-adb2e668428e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.678448 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-24e71c78-0d88-4b4f-bd88-adb2e668428e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:13:02.776685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-24e71c78-0d88-4b4f-bd88-adb2e668428e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "DELETE /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 204 len: 0 microversion: 2.20 time: 0.135700 May 26 15:13:02.780692 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 286/574] 10.222.0.46 () {60 vars in 1279 bytes} [Thu May 26 15:13:02 2022] DELETE /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:13:02.782272 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-aa20c813-c334-4463-be0e-631b00d04c0b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:02.782930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-aa20c813-c334-4463-be0e-631b00d04c0b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:02.792125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:02.793091 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:02.794837 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-aa20c813-c334-4463-be0e-631b00d04c0b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.800061 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-aa20c813-c334-4463-be0e-631b00d04c0b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.800912 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.801273 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.801405 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-aa20c813-c334-4463-be0e-631b00d04c0b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.801839 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-aa20c813-c334-4463-be0e-631b00d04c0b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.802098 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:02.802587 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:02.807174 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:03.198109 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:03.201301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-aa20c813-c334-4463-be0e-631b00d04c0b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:03.208006 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:03.208840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-aa20c813-c334-4463-be0e-631b00d04c0b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.430669 May 26 15:13:03.209429 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 289/575] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:02 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:03.209674 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:03.211664 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b2a81750-9540-4da4-9c99-373fdfd17122 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.429474 May 26 15:13:03.212218 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 287/576] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:02 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:03.223098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c753c35b-5620-4dab-83e1-77ee3be347c1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:03.223098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c753c35b-5620-4dab-83e1-77ee3be347c1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:03.223098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c753c35b-5620-4dab-83e1-77ee3be347c1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:03.223098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c753c35b-5620-4dab-83e1-77ee3be347c1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:03.223805 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c753c35b-5620-4dab-83e1-77ee3be347c1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:03.224238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c753c35b-5620-4dab-83e1-77ee3be347c1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:03.228446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-dfaba77c-0960-4368-a372-83af72cd8192 req-aee9d273-abc4-4a62-aa44-401367e460a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f", "name": "network-vif-deleted", "tag": "2b9adcd0-48a4-4233-a3fb-694dc9e1657f"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:03.232327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:03.239722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-dfaba77c-0960-4368-a372-83af72cd8192 req-aee9d273-abc4-4a62-aa44-401367e460a6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:03.240175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-dfaba77c-0960-4368-a372-83af72cd8192 req-aee9d273-abc4-4a62-aa44-401367e460a6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:03.254187 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-dfaba77c-0960-4368-a372-83af72cd8192 req-aee9d273-abc4-4a62-aa44-401367e460a6 service nova] Creating event network-vif-deleted:2b9adcd0-48a4-4233-a3fb-694dc9e1657f for instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f on hv-cinder-78836 May 26 15:13:03.259576 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-dfaba77c-0960-4368-a372-83af72cd8192 req-aee9d273-abc4-4a62-aa44-401367e460a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034696 May 26 15:13:03.260189 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 288/577] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:03.293276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c753c35b-5620-4dab-83e1-77ee3be347c1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:03.300747 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c753c35b-5620-4dab-83e1-77ee3be347c1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1615 microversion: 2.1 time: 0.089948 May 26 15:13:03.301239 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 290/578] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:03 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:03.352674 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cb22e1b4-b5f1-444d-a251-8799368cf53f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:03.354039 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cb22e1b4-b5f1-444d-a251-8799368cf53f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:03.361171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb22e1b4-b5f1-444d-a251-8799368cf53f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:03.361729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb22e1b4-b5f1-444d-a251-8799368cf53f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:03.362558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb22e1b4-b5f1-444d-a251-8799368cf53f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:03.363060 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb22e1b4-b5f1-444d-a251-8799368cf53f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:03.504679 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cb22e1b4-b5f1-444d-a251-8799368cf53f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:03.512918 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cb22e1b4-b5f1-444d-a251-8799368cf53f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.164419 May 26 15:13:03.513747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 289/579] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:03 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:04.226726 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-124ffd19-b1d5-4de3-9daa-7f07b57b3460 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:04.228042 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-124ffd19-b1d5-4de3-9daa-7f07b57b3460 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:04.231080 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:04.231973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:04.236148 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-124ffd19-b1d5-4de3-9daa-7f07b57b3460 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.236866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-124ffd19-b1d5-4de3-9daa-7f07b57b3460 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.237904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-124ffd19-b1d5-4de3-9daa-7f07b57b3460 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.238558 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-124ffd19-b1d5-4de3-9daa-7f07b57b3460 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.238830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.239278 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.240175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.240617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.448198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.452699 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-124ffd19-b1d5-4de3-9daa-7f07b57b3460 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.456472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.458011 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.459171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c9692c8b-8ea7-4b88-a458-40e82b468e9a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.232569 May 26 15:13:04.460153 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 290/580] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:04 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:04.461031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-124ffd19-b1d5-4de3-9daa-7f07b57b3460 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.238655 May 26 15:13:04.461746 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 291/581] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:04 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:04.464698 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9feecc55-0765-4e84-9b11-775aabd5e6df tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:04.465302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9feecc55-0765-4e84-9b11-775aabd5e6df tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:04.471694 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9feecc55-0765-4e84-9b11-775aabd5e6df tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.472150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9feecc55-0765-4e84-9b11-775aabd5e6df tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.472911 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9feecc55-0765-4e84-9b11-775aabd5e6df tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.473376 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9feecc55-0765-4e84-9b11-775aabd5e6df tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.530860 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3c84b7e4-e083-4bd0-a3b6-05ab56e84836 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:04.531498 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3c84b7e4-e083-4bd0-a3b6-05ab56e84836 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:04.538357 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9feecc55-0765-4e84-9b11-775aabd5e6df tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.539847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c84b7e4-e083-4bd0-a3b6-05ab56e84836 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.540467 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c84b7e4-e083-4bd0-a3b6-05ab56e84836 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.541391 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c84b7e4-e083-4bd0-a3b6-05ab56e84836 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:04.542098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3c84b7e4-e083-4bd0-a3b6-05ab56e84836 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:04.546917 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9feecc55-0765-4e84-9b11-775aabd5e6df tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 200 len: 1615 microversion: 2.1 time: 0.085812 May 26 15:13:04.548807 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 291/582] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:04 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 1615 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:04.562602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:04.715924 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3c84b7e4-e083-4bd0-a3b6-05ab56e84836 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.725264 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3c84b7e4-e083-4bd0-a3b6-05ab56e84836 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.199238 May 26 15:13:04.725869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 292/583] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:04 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:05.292698 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-15286cf8-b99e-4b18-9daa-b80c73fa6a43 req-b54e57e4-2c69-4c52-89e6-7ab98b9d907c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ffad3c3-bb0f-4e23-a684-2d87d0e05773", "tag": "3ffef797-bf12-45a3-bd7a-eb5cf65d8a6a"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:05.300849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-15286cf8-b99e-4b18-9daa-b80c73fa6a43 req-b54e57e4-2c69-4c52-89e6-7ab98b9d907c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.301299 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-15286cf8-b99e-4b18-9daa-b80c73fa6a43 req-b54e57e4-2c69-4c52-89e6-7ab98b9d907c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.313533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-15286cf8-b99e-4b18-9daa-b80c73fa6a43 req-b54e57e4-2c69-4c52-89e6-7ab98b9d907c service nova] Creating event network-changed:3ffef797-bf12-45a3-bd7a-eb5cf65d8a6a for instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 on hv-cinder-78836 May 26 15:13:05.318867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-15286cf8-b99e-4b18-9daa-b80c73fa6a43 req-b54e57e4-2c69-4c52-89e6-7ab98b9d907c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029863 May 26 15:13:05.319617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 292/584] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:05.478477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-2cccdf6f-7626-4c3f-bbd5-6836acfcc674 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:05.479891 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-2cccdf6f-7626-4c3f-bbd5-6836acfcc674 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:05.480459 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:05.481745 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:05.488575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2cccdf6f-7626-4c3f-bbd5-6836acfcc674 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.489398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2cccdf6f-7626-4c3f-bbd5-6836acfcc674 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.490514 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2cccdf6f-7626-4c3f-bbd5-6836acfcc674 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.491313 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2cccdf6f-7626-4c3f-bbd5-6836acfcc674 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.515068 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.515528 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.516325 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.516768 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.872465 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:05.879553 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-2cccdf6f-7626-4c3f-bbd5-6836acfcc674 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:05.881096 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:05.882662 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:05.883842 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3551b139-abd5-48d3-8b8b-6e50a980f8cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1723 microversion: 2.20 time: 0.408934 May 26 15:13:05.884605 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 293/585] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:05 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1723 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:05.901604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:05.902363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:05.903873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-2cccdf6f-7626-4c3f-bbd5-6836acfcc674 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.429782 May 26 15:13:05.904978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 293/586] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:05 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:05.909052 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.909547 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.910329 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.911843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-270a9f8f-3161-47f9-819f-639f523c008b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:05.915069 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-270a9f8f-3161-47f9-819f-639f523c008b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:05.927571 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.931243 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-270a9f8f-3161-47f9-819f-639f523c008b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.935298 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-270a9f8f-3161-47f9-819f-639f523c008b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.938039 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-270a9f8f-3161-47f9-819f-639f523c008b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:05.938580 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-270a9f8f-3161-47f9-819f-639f523c008b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:05.950214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f HTTP/1.1 May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:13:05.956134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:13:05.957775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f'} May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:13:05.958628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:13:05.960156 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:05.962974 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:13:05.964722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-82fc7020-158f-47d7-9839-4d82719305ab tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 404 len: 111 microversion: 2.1 time: 0.068571 May 26 15:13:05.965783 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 294/587] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:05 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:13:05.975964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-02a2ec2a-90c3-4316-abaf-fc48cd70beb7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '.version_select at 0x7ff965f28670>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:06.007225 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-02a2ec2a-90c3-4316-abaf-fc48cd70beb7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202950527" status: 202 len: 0 microversion: 2.1 time: 0.034887 May 26 15:13:06.008697 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 295/588] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 15:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202950527 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:13:06.216387 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-270a9f8f-3161-47f9-819f-639f523c008b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:06.228154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-270a9f8f-3161-47f9-819f-639f523c008b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.321925 May 26 15:13:06.241055 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 294/589] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:05 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:06.584027 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-b8c523c8-b0a8-4375-aba8-c6fee8786729 req-38c080c0-59c5-4547-9c50-8b1f4daa3fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06cf01b4-e458-498b-990e-33b4171e1a14", "name": "network-vif-deleted", "tag": "2e5306c2-86c5-4899-9abd-3ff6e390eb95"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:06.594030 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b8c523c8-b0a8-4375-aba8-c6fee8786729 req-38c080c0-59c5-4547-9c50-8b1f4daa3fb2 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:06.594475 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b8c523c8-b0a8-4375-aba8-c6fee8786729 req-38c080c0-59c5-4547-9c50-8b1f4daa3fb2 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:06.606423 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-b8c523c8-b0a8-4375-aba8-c6fee8786729 req-38c080c0-59c5-4547-9c50-8b1f4daa3fb2 service nova] Creating event network-vif-deleted:2e5306c2-86c5-4899-9abd-3ff6e390eb95 for instance 06cf01b4-e458-498b-990e-33b4171e1a14 on hv-cinder-78836 May 26 15:13:06.614571 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-b8c523c8-b0a8-4375-aba8-c6fee8786729 req-38c080c0-59c5-4547-9c50-8b1f4daa3fb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034549 May 26 15:13:06.615460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 296/590] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:06.903267 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:06.904946 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:06.911797 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:06.912464 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:06.913333 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:06.915499 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:06.923085 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8733b3cf-8c3d-4c60-863f-eeba99946888 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:06.924007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8733b3cf-8c3d-4c60-863f-eeba99946888 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:06.930826 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8733b3cf-8c3d-4c60-863f-eeba99946888 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:06.931496 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8733b3cf-8c3d-4c60-863f-eeba99946888 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:06.932800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8733b3cf-8c3d-4c60-863f-eeba99946888 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:06.933247 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8733b3cf-8c3d-4c60-863f-eeba99946888 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:06.990113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.000589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.002152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.003327 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-84965ce9-a0cc-4dfb-8be7-f6b2eefb2c20 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1656 microversion: 2.20 time: 0.104660 May 26 15:13:07.015539 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 295/591] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:06 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1656 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:07.098329 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8733b3cf-8c3d-4c60-863f-eeba99946888 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.113593 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8733b3cf-8c3d-4c60-863f-eeba99946888 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.196864 May 26 15:13:07.114393 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 297/592] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:06 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:07.238296 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-67f088da-2ea1-4f76-b80f-721d63b63a01 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:07.238792 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-67f088da-2ea1-4f76-b80f-721d63b63a01 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:07.246150 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-67f088da-2ea1-4f76-b80f-721d63b63a01 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.246600 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-67f088da-2ea1-4f76-b80f-721d63b63a01 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.247327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-acaf156c-d829-468f-abeb-8c847b908d87 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:07.247456 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-67f088da-2ea1-4f76-b80f-721d63b63a01 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.247807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-67f088da-2ea1-4f76-b80f-721d63b63a01 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.248259 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-acaf156c-d829-468f-abeb-8c847b908d87 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:07.254376 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acaf156c-d829-468f-abeb-8c847b908d87 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.254909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acaf156c-d829-468f-abeb-8c847b908d87 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.255963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acaf156c-d829-468f-abeb-8c847b908d87 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.256473 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-acaf156c-d829-468f-abeb-8c847b908d87 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.339292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-67f088da-2ea1-4f76-b80f-721d63b63a01 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lazy-loading 'services' on Instance uuid 957f4d2d-884d-44ff-9aee-1acf1b6c8959 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:13:07.396674 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-acaf156c-d829-468f-abeb-8c847b908d87 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.406040 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-acaf156c-d829-468f-abeb-8c847b908d87 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.162521 May 26 15:13:07.416264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 298/593] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:07 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:07.427707 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-67f088da-2ea1-4f76-b80f-721d63b63a01 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments/d5d7a372-93b8-41b0-aed0-fecd493e3e19" status: 202 len: 0 microversion: 2.1 time: 0.193103 May 26 15:13:07.428384 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 296/594] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:13:07 2022] DELETE /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments/d5d7a372-93b8-41b0-aed0-fecd493e3e19 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:13:07.437547 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b9a1dfed-53ab-4573-96ce-3b3e7de2d389 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:07.439090 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b9a1dfed-53ab-4573-96ce-3b3e7de2d389 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:07.445980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9a1dfed-53ab-4573-96ce-3b3e7de2d389 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.446592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9a1dfed-53ab-4573-96ce-3b3e7de2d389 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.447453 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9a1dfed-53ab-4573-96ce-3b3e7de2d389 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:07.448266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b9a1dfed-53ab-4573-96ce-3b3e7de2d389 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:07.481506 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b9a1dfed-53ab-4573-96ce-3b3e7de2d389 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048480 May 26 15:13:07.482305 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 299/595] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:13:07 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:08.023926 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:08.024540 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:08.031700 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.032154 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.032936 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.033371 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.062657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.063099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.063538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lazy-loading 'fault' on Instance uuid 06cf01b4-e458-498b-990e-33b4171e1a14 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:13:08.104580 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.112461 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.114005 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.115186 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9ea4e922-e7b7-4431-8e04-b03ef8d9889c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 200 len: 1372 microversion: 2.20 time: 0.096205 May 26 15:13:08.115809 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 297/596] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:08 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:08.130883 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9fa3a708-bbd4-4e8d-968f-140d9102641e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:08.131577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9fa3a708-bbd4-4e8d-968f-140d9102641e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:08.138157 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa3a708-bbd4-4e8d-968f-140d9102641e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.139279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa3a708-bbd4-4e8d-968f-140d9102641e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.140045 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa3a708-bbd4-4e8d-968f-140d9102641e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.140489 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa3a708-bbd4-4e8d-968f-140d9102641e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.270255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9fa3a708-bbd4-4e8d-968f-140d9102641e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.277564 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9fa3a708-bbd4-4e8d-968f-140d9102641e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.150533 May 26 15:13:08.278058 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 300/597] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:08 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:08.423820 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-51dfce5d-dd75-4096-81e9-f5e4ea85f595 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:08.424440 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-51dfce5d-dd75-4096-81e9-f5e4ea85f595 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:08.430454 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-51dfce5d-dd75-4096-81e9-f5e4ea85f595 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.430908 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-51dfce5d-dd75-4096-81e9-f5e4ea85f595 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.431668 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-51dfce5d-dd75-4096-81e9-f5e4ea85f595 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.432112 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-51dfce5d-dd75-4096-81e9-f5e4ea85f595 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.493011 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-14913e43-00b3-4af6-a76d-4fc8541f4fd0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:08.493997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-14913e43-00b3-4af6-a76d-4fc8541f4fd0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:08.501058 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-14913e43-00b3-4af6-a76d-4fc8541f4fd0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.501544 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-14913e43-00b3-4af6-a76d-4fc8541f4fd0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.502313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-14913e43-00b3-4af6-a76d-4fc8541f4fd0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:08.502754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-14913e43-00b3-4af6-a76d-4fc8541f4fd0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:08.535446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-14913e43-00b3-4af6-a76d-4fc8541f4fd0 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 May 26 15:13:08.535927 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 301/598] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:13:08 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:13:08.574234 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-51dfce5d-dd75-4096-81e9-f5e4ea85f595 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.582255 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-51dfce5d-dd75-4096-81e9-f5e4ea85f595 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1677 microversion: 2.1 time: 0.162321 May 26 15:13:08.583020 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 298/599] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:08 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:09.135056 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.135748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.143214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.143670 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.144440 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.144884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.158180 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] HTTP exception thrown: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Request method failure captured: May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 HTTP/1.1 May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gUhO06JI6AeLiy_7dQ3CouXcrfPamsSamRsQvezK4atrv8EjQ69Nc7uZgXACo6Itq5VGV6w_Zf5onjCXm9VIpYD1CrcbLjNhOa8SHzsBx65Ex8uL0jCWXLejtAUHD4sFM9Ps1LmUhS1_LNKt5L1HGoMFQ6KOwt3yrZbr3l5Qy7AOI May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:13:09.159867 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d732418a4b2247e59ed96898b21cf6b1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d732418a4b2247e59ed96898b21cf6b1"}]}] May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 64aeada36ebe460e9969f1f048651e6d May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:13:09.161410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '06cf01b4-e458-498b-990e-33b4171e1a14'} May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:13:09.162353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:13:09.163699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:13:09.164914 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Returning 404 to user: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:13:09.164914 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-de2c51ea-e239-4411-834e-85fed922bcbb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 404 len: 111 microversion: 2.20 time: 0.030997 May 26 15:13:09.164914 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 302/600] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:09 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:13:09.170327 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7f6b07f2-4eb4-4c82-b181-1f9fe0adf65b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '.version_select at 0x7ff96591e3a0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.192336 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7f6b07f2-4eb4-4c82-b181-1f9fe0adf65b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266453240" status: 204 len: 0 microversion: 2.20 time: 0.025848 May 26 15:13:09.192955 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 299/601] 10.222.0.46 () {60 vars in 1261 bytes} [Thu May 26 15:13:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266453240 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:13:09.294195 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-86a19583-aeea-456f-9d15-74c6f6b43999 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.295396 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-86a19583-aeea-456f-9d15-74c6f6b43999 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.301610 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86a19583-aeea-456f-9d15-74c6f6b43999 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.302061 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86a19583-aeea-456f-9d15-74c6f6b43999 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.302817 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86a19583-aeea-456f-9d15-74c6f6b43999 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.303250 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-86a19583-aeea-456f-9d15-74c6f6b43999 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.366292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:09.449335 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-86a19583-aeea-456f-9d15-74c6f6b43999 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:09.456805 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-86a19583-aeea-456f-9d15-74c6f6b43999 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.166520 May 26 15:13:09.457366 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 303/602] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:09 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:09.547607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d3387fe3-c9f1-4c08-8a1b-60ffcdee1b29 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.548651 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d3387fe3-c9f1-4c08-8a1b-60ffcdee1b29 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.555166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3387fe3-c9f1-4c08-8a1b-60ffcdee1b29 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.555628 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3387fe3-c9f1-4c08-8a1b-60ffcdee1b29 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.556432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3387fe3-c9f1-4c08-8a1b-60ffcdee1b29 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.556876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d3387fe3-c9f1-4c08-8a1b-60ffcdee1b29 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.587155 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d3387fe3-c9f1-4c08-8a1b-60ffcdee1b29 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044186 May 26 15:13:09.587716 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 300/603] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:13:09 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:13:09.598902 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-276b049c-6c8b-4f8f-be32-e954990d7285 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.599521 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-276b049c-6c8b-4f8f-be32-e954990d7285 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.601445 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=8 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:09.608852 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-276b049c-6c8b-4f8f-be32-e954990d7285 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.609339 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-276b049c-6c8b-4f8f-be32-e954990d7285 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.610626 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-276b049c-6c8b-4f8f-be32-e954990d7285 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.611242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-276b049c-6c8b-4f8f-be32-e954990d7285 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.664927 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-855fbefe-533b-4d2b-a3a4-7f095dd65748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.665717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-855fbefe-533b-4d2b-a3a4-7f095dd65748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.672911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-855fbefe-533b-4d2b-a3a4-7f095dd65748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.673618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-855fbefe-533b-4d2b-a3a4-7f095dd65748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.674549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-855fbefe-533b-4d2b-a3a4-7f095dd65748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.675143 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-855fbefe-533b-4d2b-a3a4-7f095dd65748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.707090 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-855fbefe-533b-4d2b-a3a4-7f095dd65748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:13:09.772430 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-276b049c-6c8b-4f8f-be32-e954990d7285 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:09.782288 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-276b049c-6c8b-4f8f-be32-e954990d7285 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1654 microversion: 2.1 time: 0.186939 May 26 15:13:09.794428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 304/604] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:09 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1654 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:09.804072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1e6f8906-2949-4e63-8f1e-a4c696cfe10d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:09.814443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1e6f8906-2949-4e63-8f1e-a4c696cfe10d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.814937 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1e6f8906-2949-4e63-8f1e-a4c696cfe10d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.818339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-855fbefe-533b-4d2b-a3a4-7f095dd65748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 204 len: 0 microversion: 2.1 time: 0.156900 May 26 15:13:09.822310 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 301/605] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:13:09 2022] DELETE /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:13:09.839673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7fdad130-b410-4271-8158-f35b1e394a44 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.840667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7fdad130-b410-4271-8158-f35b1e394a44 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.842575 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1e6f8906-2949-4e63-8f1e-a4c696cfe10d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Going to try to start instance {{(pid=117723) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 15:13:09.847930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7fdad130-b410-4271-8158-f35b1e394a44 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.848386 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7fdad130-b410-4271-8158-f35b1e394a44 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.849155 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7fdad130-b410-4271-8158-f35b1e394a44 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.849629 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7fdad130-b410-4271-8158-f35b1e394a44 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.887154 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1e6f8906-2949-4e63-8f1e-a4c696cfe10d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/action" status: 202 len: 0 microversion: 2.1 time: 0.089490 May 26 15:13:09.887753 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 305/606] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:13:09 2022] POST /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:13:09.893006 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9c89e08f-e5fa-4475-b0a4-693e69362a41 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'create', calling method: .version_select at 0x7ff965fd4310>, body: {"keypair": {"name": "tempest-keypair-515244224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyMA0StpYI7y6z3vtZpYzQeJgq+m+6zvTqx0SoRweAQrNAboQQTamNKn/Ln27np/5HR8eDqqss5g0bUcCcKBQeJk/huRrmZCru5py8QWR3KzjN60dU4dibYU4NvsVfEWg=="}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:09.907779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-9c89e08f-e5fa-4475-b0a4-693e69362a41 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Getting quotas for project d732418a4b2247e59ed96898b21cf6b1. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:13:09.911617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-9c89e08f-e5fa-4475-b0a4-693e69362a41 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Getting quotas for user 64aeada36ebe460e9969f1f048651e6d and project d732418a4b2247e59ed96898b21cf6b1. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:13:09.938226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9c89e08f-e5fa-4475-b0a4-693e69362a41 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049234 May 26 15:13:09.944385 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 306/607] 10.222.0.46 () {62 vars in 1199 bytes} [Thu May 26 15:13:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 15:13:09.944385 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1662920f-0d68-44f4-9dfe-23cfe2dc8fab tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.954349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1662920f-0d68-44f4-9dfe-23cfe2dc8fab tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:09.965828 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1662920f-0d68-44f4-9dfe-23cfe2dc8fab tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.966076 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1662920f-0d68-44f4-9dfe-23cfe2dc8fab tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:09.967436 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1662920f-0d68-44f4-9dfe-23cfe2dc8fab tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:09.967875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1662920f-0d68-44f4-9dfe-23cfe2dc8fab tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:10.009598 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7fdad130-b410-4271-8158-f35b1e394a44 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:10.020529 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7fdad130-b410-4271-8158-f35b1e394a44 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1682 microversion: 2.1 time: 0.185570 May 26 15:13:10.021336 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 302/608] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:09 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:10.139099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1662920f-0d68-44f4-9dfe-23cfe2dc8fab tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:10.150495 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1662920f-0d68-44f4-9dfe-23cfe2dc8fab tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1663 microversion: 2.1 time: 0.209866 May 26 15:13:10.151510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 307/609] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:09 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1663 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:10.473770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-2b7b5b10-f289-4264-a715-d7016b87428e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:10.474394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-2b7b5b10-f289-4264-a715-d7016b87428e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:10.481247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2b7b5b10-f289-4264-a715-d7016b87428e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:10.481724 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2b7b5b10-f289-4264-a715-d7016b87428e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:10.483201 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2b7b5b10-f289-4264-a715-d7016b87428e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:10.483644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2b7b5b10-f289-4264-a715-d7016b87428e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:10.616565 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-2b7b5b10-f289-4264-a715-d7016b87428e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:10.624941 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-2b7b5b10-f289-4264-a715-d7016b87428e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.155181 May 26 15:13:10.625699 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 303/610] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:10 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:11.039217 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a271ca14-48c5-4a47-9df9-2d19ec7077ff tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:11.039745 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a271ca14-48c5-4a47-9df9-2d19ec7077ff tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:11.046354 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a271ca14-48c5-4a47-9df9-2d19ec7077ff tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.046816 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a271ca14-48c5-4a47-9df9-2d19ec7077ff tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.047588 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a271ca14-48c5-4a47-9df9-2d19ec7077ff tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.048028 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a271ca14-48c5-4a47-9df9-2d19ec7077ff tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.052100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:11.168360 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a671bbb9-e4f8-485c-b8ce-2ab2b82deaeb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:11.170511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a671bbb9-e4f8-485c-b8ce-2ab2b82deaeb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:11.177264 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a671bbb9-e4f8-485c-b8ce-2ab2b82deaeb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.178056 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a671bbb9-e4f8-485c-b8ce-2ab2b82deaeb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.179027 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a671bbb9-e4f8-485c-b8ce-2ab2b82deaeb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.186305 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a671bbb9-e4f8-485c-b8ce-2ab2b82deaeb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.192744 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a271ca14-48c5-4a47-9df9-2d19ec7077ff tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:11.202223 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a271ca14-48c5-4a47-9df9-2d19ec7077ff tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1682 microversion: 2.1 time: 0.167035 May 26 15:13:11.202999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 308/611] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:11 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:11.306848 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-896486636", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cc6f64a-79d5-4535-9da7-4cf3dfad5e95"}], "security_groups": [{"name": "tempest-securitygroup--659396654"}], "key_name": "tempest-keypair-515244224", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:11.326535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a671bbb9-e4f8-485c-b8ce-2ab2b82deaeb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:11.333989 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a671bbb9-e4f8-485c-b8ce-2ab2b82deaeb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1663 microversion: 2.1 time: 0.169674 May 26 15:13:11.334647 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 304/612] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:11 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:11.409232 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] validate_networks() for [('4cc6f64a-79d5-4535-9da7-4cf3dfad5e95', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:13:11.642059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-041fd0b6-4bb7-40c8-8206-a11455e00f99 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:11.642788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-041fd0b6-4bb7-40c8-8206-a11455e00f99 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:11.650166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-041fd0b6-4bb7-40c8-8206-a11455e00f99 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.650619 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-041fd0b6-4bb7-40c8-8206-a11455e00f99 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:11.651383 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-041fd0b6-4bb7-40c8-8206-a11455e00f99 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:11.651817 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-041fd0b6-4bb7-40c8-8206-a11455e00f99 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.172714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:13:12.173132 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-041fd0b6-4bb7-40c8-8206-a11455e00f99 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.175678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:13:12.176493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:13:12.177175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:13:12.177693 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:13:12.184486 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-041fd0b6-4bb7-40c8-8206-a11455e00f99 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.546263 May 26 15:13:12.186321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 305/613] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:11 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:12.192995 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-5407a682-16ae-4876-aa58-9e8c5a6b7b0e req-bc47196c-0c18-4a6e-bc6e-32e273272b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ffad3c3-bb0f-4e23-a684-2d87d0e05773", "name": "network-vif-plugged", "status": "completed", "tag": "3ffef797-bf12-45a3-bd7a-eb5cf65d8a6a"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:12.198370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.198884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.199764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.200726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.208174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-5407a682-16ae-4876-aa58-9e8c5a6b7b0e req-bc47196c-0c18-4a6e-bc6e-32e273272b14 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.209124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-5407a682-16ae-4876-aa58-9e8c5a6b7b0e req-bc47196c-0c18-4a6e-bc6e-32e273272b14 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.220798 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Getting quotas for project d732418a4b2247e59ed96898b21cf6b1. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:13:12.224229 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-5407a682-16ae-4876-aa58-9e8c5a6b7b0e req-bc47196c-0c18-4a6e-bc6e-32e273272b14 service nova] Creating event network-vif-plugged:3ffef797-bf12-45a3-bd7a-eb5cf65d8a6a for instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 on hv-cinder-78836 May 26 15:13:12.225096 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Getting quotas for user 64aeada36ebe460e9969f1f048651e6d and project d732418a4b2247e59ed96898b21cf6b1. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:13:12.232615 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-5407a682-16ae-4876-aa58-9e8c5a6b7b0e req-bc47196c-0c18-4a6e-bc6e-32e273272b14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043353 May 26 15:13:12.233612 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 306/614] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:12.238906 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-72a6b1d7-cc3a-47d2-93db-06da14a5c660 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:12.239615 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-72a6b1d7-cc3a-47d2-93db-06da14a5c660 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:12.240635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:13:12.243029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:13:12.246565 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-72a6b1d7-cc3a-47d2-93db-06da14a5c660 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.247190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-72a6b1d7-cc3a-47d2-93db-06da14a5c660 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.248707 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-72a6b1d7-cc3a-47d2-93db-06da14a5c660 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.249299 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-72a6b1d7-cc3a-47d2-93db-06da14a5c660 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.317233 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6d0f3b36-d0b1-44d0-9cfc-d9c94713d21f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.014449 May 26 15:13:12.317772 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 309/615] 10.222.0.46 () {62 vars in 1187 bytes} [Thu May 26 15:13:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 15:13:12.335196 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-98dcc48a-a860-43d7-99bb-8c1136f8d188 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:12.340150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-98dcc48a-a860-43d7-99bb-8c1136f8d188 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:12.442057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-98dcc48a-a860-43d7-99bb-8c1136f8d188 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.453672 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-98dcc48a-a860-43d7-99bb-8c1136f8d188 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.455253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-98dcc48a-a860-43d7-99bb-8c1136f8d188 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.456380 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-98dcc48a-a860-43d7-99bb-8c1136f8d188 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1280 microversion: 2.20 time: 0.132309 May 26 15:13:12.457343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 310/616] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:12 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:12.470718 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2139c3e1-1755-4296-a447-151c93166035 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:12.471553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2139c3e1-1755-4296-a447-151c93166035 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:12.479878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2139c3e1-1755-4296-a447-151c93166035 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.480885 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2139c3e1-1755-4296-a447-151c93166035 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.481865 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2139c3e1-1755-4296-a447-151c93166035 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.483257 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2139c3e1-1755-4296-a447-151c93166035 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.529408 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-72a6b1d7-cc3a-47d2-93db-06da14a5c660 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.536932 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-72a6b1d7-cc3a-47d2-93db-06da14a5c660 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1682 microversion: 2.1 time: 0.301958 May 26 15:13:12.537532 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 307/617] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:12 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1682 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:12.777569 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2139c3e1-1755-4296-a447-151c93166035 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.786105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2139c3e1-1755-4296-a447-151c93166035 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1663 microversion: 2.1 time: 0.327409 May 26 15:13:12.786677 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 311/618] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:12 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1663 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:12.916011 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-4af47597-3310-4d91-b066-0db772aae2ab req-b4462701-2c41-43e0-ad56-da7da64e607a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "957f4d2d-884d-44ff-9aee-1acf1b6c8959", "name": "network-vif-deleted", "tag": "800ecb9f-4310-4563-b53c-ff8623e28b8e"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:12.924931 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-4af47597-3310-4d91-b066-0db772aae2ab req-b4462701-2c41-43e0-ad56-da7da64e607a service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:12.925370 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-4af47597-3310-4d91-b066-0db772aae2ab req-b4462701-2c41-43e0-ad56-da7da64e607a service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:12.929071 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:12.936723 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-4af47597-3310-4d91-b066-0db772aae2ab req-b4462701-2c41-43e0-ad56-da7da64e607a service nova] Creating event network-vif-deleted:800ecb9f-4310-4563-b53c-ff8623e28b8e for instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 on hv-cinder-78836 May 26 15:13:12.941669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-4af47597-3310-4d91-b066-0db772aae2ab req-b4462701-2c41-43e0-ad56-da7da64e607a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029182 May 26 15:13:12.942191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 308/619] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:13.203082 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6b2a5c53-a0b8-4508-9b61-04e5be9aa9a5 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:13.204288 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6b2a5c53-a0b8-4508-9b61-04e5be9aa9a5 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:13.211221 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b2a5c53-a0b8-4508-9b61-04e5be9aa9a5 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.211672 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b2a5c53-a0b8-4508-9b61-04e5be9aa9a5 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.212450 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b2a5c53-a0b8-4508-9b61-04e5be9aa9a5 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.213018 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6b2a5c53-a0b8-4508-9b61-04e5be9aa9a5 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.345773 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6b2a5c53-a0b8-4508-9b61-04e5be9aa9a5 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.353435 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6b2a5c53-a0b8-4508-9b61-04e5be9aa9a5 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.154733 May 26 15:13:13.354029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 312/620] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:13 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:13.479930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:13.480559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:13.491382 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.492010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.492789 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.493234 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.554115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-79e57365-e9a6-4b0a-af4d-3e44236769b7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:13.554947 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-79e57365-e9a6-4b0a-af4d-3e44236769b7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:13.562030 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79e57365-e9a6-4b0a-af4d-3e44236769b7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.562594 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79e57365-e9a6-4b0a-af4d-3e44236769b7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.563255 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.563598 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79e57365-e9a6-4b0a-af4d-3e44236769b7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.564142 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79e57365-e9a6-4b0a-af4d-3e44236769b7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.571456 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.572992 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.574141 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5b37fb1d-2f93-4eee-83bf-e49cf6830431 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1284 microversion: 2.20 time: 0.099182 May 26 15:13:13.574700 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 309/621] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:13 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:13.645791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-79e57365-e9a6-4b0a-af4d-3e44236769b7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.657166 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-79e57365-e9a6-4b0a-af4d-3e44236769b7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1326 microversion: 2.1 time: 0.106926 May 26 15:13:13.657934 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 313/622] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:13 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:13.805062 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b3e48deb-926b-4325-8178-e7256fdb5bf9 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:13.805754 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b3e48deb-926b-4325-8178-e7256fdb5bf9 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:13.812187 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b3e48deb-926b-4325-8178-e7256fdb5bf9 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.812630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b3e48deb-926b-4325-8178-e7256fdb5bf9 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.813392 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b3e48deb-926b-4325-8178-e7256fdb5bf9 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:13.813850 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b3e48deb-926b-4325-8178-e7256fdb5bf9 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:13.952915 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b3e48deb-926b-4325-8178-e7256fdb5bf9 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.960632 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b3e48deb-926b-4325-8178-e7256fdb5bf9 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1663 microversion: 2.1 time: 0.160481 May 26 15:13:13.961203 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 310/623] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:13 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:14.370929 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f2d3cc95-5a7c-425f-8084-5f9a23f9df6b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:14.371552 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f2d3cc95-5a7c-425f-8084-5f9a23f9df6b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:14.379239 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f2d3cc95-5a7c-425f-8084-5f9a23f9df6b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.379687 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f2d3cc95-5a7c-425f-8084-5f9a23f9df6b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.380447 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f2d3cc95-5a7c-425f-8084-5f9a23f9df6b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.380883 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f2d3cc95-5a7c-425f-8084-5f9a23f9df6b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.519305 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f2d3cc95-5a7c-425f-8084-5f9a23f9df6b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.532881 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f2d3cc95-5a7c-425f-8084-5f9a23f9df6b tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1319 microversion: 2.1 time: 0.166192 May 26 15:13:14.534458 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 314/624] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:14 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:14.591893 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:14.592534 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:14.598991 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.599448 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.600212 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.600648 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.666194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.674558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:14.675036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.675185 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:14.676557 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.677704 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b932aeff-82cf-473a-91ff-80ddc3056046 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1332 microversion: 2.20 time: 0.089695 May 26 15:13:14.678264 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 311/625] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:14 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:14.681111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.681598 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.682346 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.682779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.713655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.714102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.714548 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lazy-loading 'fault' on Instance uuid 957f4d2d-884d-44ff-9aee-1acf1b6c8959 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:13:14.756013 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.763491 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0df6ed2b-a922-4d1a-be1b-8bcfcabea12d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 200 len: 1331 microversion: 2.1 time: 0.092763 May 26 15:13:14.764056 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 315/626] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:14 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:14.979120 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-340a05a5-e3f4-4240-8363-7d921c358a39 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:14.979636 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-340a05a5-e3f4-4240-8363-7d921c358a39 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:14.986911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-340a05a5-e3f4-4240-8363-7d921c358a39 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.987366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-340a05a5-e3f4-4240-8363-7d921c358a39 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:14.988128 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-340a05a5-e3f4-4240-8363-7d921c358a39 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:14.988566 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-340a05a5-e3f4-4240-8363-7d921c358a39 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.118459 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-340a05a5-e3f4-4240-8363-7d921c358a39 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:15.126234 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-340a05a5-e3f4-4240-8363-7d921c358a39 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1667 microversion: 2.1 time: 0.151186 May 26 15:13:15.126810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 312/627] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:14 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1667 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:15.551010 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ebc71234-cd99-42bf-b4e2-d172b5842365 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:15.551618 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ebc71234-cd99-42bf-b4e2-d172b5842365 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:15.558207 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebc71234-cd99-42bf-b4e2-d172b5842365 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.558648 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebc71234-cd99-42bf-b4e2-d172b5842365 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.559393 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebc71234-cd99-42bf-b4e2-d172b5842365 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.559824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ebc71234-cd99-42bf-b4e2-d172b5842365 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.696731 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:15.697262 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:15.703031 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ebc71234-cd99-42bf-b4e2-d172b5842365 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:15.704163 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.704614 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.705388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.705851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.711163 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ebc71234-cd99-42bf-b4e2-d172b5842365 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1508 microversion: 2.1 time: 0.163932 May 26 15:13:15.711722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 316/628] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:15 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:15.728872 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b1941796-6aed-45aa-85e0-1aafaca3e1bf tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10bd3dbb-7f10-4d05-8497-1e58325a10ac", "device": "/dev/sdb"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:15.730587 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b1941796-6aed-45aa-85e0-1aafaca3e1bf tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:15.737616 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b1941796-6aed-45aa-85e0-1aafaca3e1bf tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.738073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b1941796-6aed-45aa-85e0-1aafaca3e1bf tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.738839 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b1941796-6aed-45aa-85e0-1aafaca3e1bf tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.739277 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b1941796-6aed-45aa-85e0-1aafaca3e1bf tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.770714 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:15.779318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:15.780834 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:15.781981 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-98a18c19-a40d-4a0d-a343-c9ad2f20c2d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1332 microversion: 2.20 time: 0.089664 May 26 15:13:15.782539 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 313/629] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:15 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:15.786966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:15.787575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:15.789487 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:15.796765 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.797291 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.798165 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:15.798675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:15.815604 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 HTTP/1.1 May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:13:15.817402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:13:15.818667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '957f4d2d-884d-44ff-9aee-1acf1b6c8959'} May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:13:15.819369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:13:15.820735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:15.821796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:13:15.821796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7b010b71-b1dc-4e1d-b8e0-02aab8b4a2c2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 404 len: 111 microversion: 2.1 time: 0.035316 May 26 15:13:15.821796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 314/630] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:15 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:13:15.827779 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-26d4da18-4959-471d-a04c-f5d6f25f6beb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '.version_select at 0x7ff9656cdee0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:15.845170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-26d4da18-4959-471d-a04c-f5d6f25f6beb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061188028" status: 202 len: 0 microversion: 2.1 time: 0.021166 May 26 15:13:15.845762 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 315/631] 10.222.0.46 () {58 vars in 1220 bytes} [Thu May 26 15:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061188028 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:13:16.264345 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b1941796-6aed-45aa-85e0-1aafaca3e1bf tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "POST /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538593 May 26 15:13:16.265287 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 317/632] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:13:15 2022] POST /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:13:16.707126 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a1bfefe8-999b-4b9f-882d-260d8c724922 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: .version_select at 0x7ff9657739d0>, body: {"keypair": {"name": "tempest-keypair-725305560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsJvS9K9lEkYASt39tRBYyrjL89GBaiNCOWAXRXrSFBMkDb7/g+HRvy1avNJxROdWAOYwAvBkfVd3qZId4W7jp6UlUxLNG+qsRs5U4XP0b43ZFTTuybHEdUhgPFs6qlBg=="}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:16.722548 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-a1bfefe8-999b-4b9f-882d-260d8c724922 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for project 9780d0cae62c4f5088060b530571ebb3. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:13:16.726572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-a1bfefe8-999b-4b9f-882d-260d8c724922 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for user 2ce5b5d5a12743bc80a4b191c24ff52f and project 9780d0cae62c4f5088060b530571ebb3. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:13:16.749674 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a1bfefe8-999b-4b9f-882d-260d8c724922 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046957 May 26 15:13:16.750269 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 316/633] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:13:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:16.801482 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:16.802186 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:16.809406 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:16.810268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:16.811459 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:16.812008 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:16.894398 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.904696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.906525 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.907695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b366c285-dfe8-4c9c-8900-2cd356d74ebd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1338 microversion: 2.20 time: 0.111010 May 26 15:13:16.908292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 318/634] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:16 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:17.927201 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:17.927879 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:17.934238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.935364 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:17.936364 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:17.936803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:18.252881 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.261427 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.262995 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.264113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9c61c05d-c200-47a0-9f97-8f05e19abe80 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.342101 May 26 15:13:18.274275 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 317/635] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:17 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:18.793390 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-871849ce-37f6-4516-90d4-e964dfb76ad8 req-4fbb27e7-a7c1-4ace-b4e6-10a9d392b85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399eff3a-ae28-4b3d-a00c-36e004e509da", "tag": "f7a772e1-226c-4379-8092-198295987b70"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:18.807695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-871849ce-37f6-4516-90d4-e964dfb76ad8 req-4fbb27e7-a7c1-4ace-b4e6-10a9d392b85f service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:18.808081 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-871849ce-37f6-4516-90d4-e964dfb76ad8 req-4fbb27e7-a7c1-4ace-b4e6-10a9d392b85f service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:18.824394 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-871849ce-37f6-4516-90d4-e964dfb76ad8 req-4fbb27e7-a7c1-4ace-b4e6-10a9d392b85f service nova] Creating event network-changed:f7a772e1-226c-4379-8092-198295987b70 for instance 399eff3a-ae28-4b3d-a00c-36e004e509da on hv-cinder-78836 May 26 15:13:18.829166 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-871849ce-37f6-4516-90d4-e964dfb76ad8 req-4fbb27e7-a7c1-4ace-b4e6-10a9d392b85f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040819 May 26 15:13:18.830621 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 319/636] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:19.282728 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:19.283480 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:19.290097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.290677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.291703 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.292378 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.318062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1574738218", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf638e18-3aa1-4ba6-b2c0-e624f717acb0"}], "security_groups": [{"name": "tempest-securitygroup--696943047"}], "key_name": "tempest-keypair-725305560", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:19.470970 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] validate_networks() for [('bf638e18-3aa1-4ba6-b2c0-e624f717acb0', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:13:19.483679 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:19.492809 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:19.494363 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:19.495739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8d3957ec-3001-4f0d-93aa-dd90c98d8562 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.217765 May 26 15:13:19.496301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 318/637] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:19 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:19.842968 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:13:19.843394 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:13:19.843849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:13:19.844255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:13:19.844665 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:13:19.846913 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:19.856625 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.857731 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.858527 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:19.858961 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:19.877182 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for project 9780d0cae62c4f5088060b530571ebb3. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:13:19.882045 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for user 2ce5b5d5a12743bc80a4b191c24ff52f and project 9780d0cae62c4f5088060b530571ebb3. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:13:19.894119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:13:19.896591 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:13:19.942506 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9a56caeb-9db1-4e37-84a6-5e52a36378cd tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.630322 May 26 15:13:19.943345 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 320/638] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:13:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:13:19.953390 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8edd9caa-c07b-4530-955f-e003bf45c08c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:19.954026 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8edd9caa-c07b-4530-955f-e003bf45c08c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:20.008292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8edd9caa-c07b-4530-955f-e003bf45c08c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:20.014914 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8edd9caa-c07b-4530-955f-e003bf45c08c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1241 microversion: 2.1 time: 0.065440 May 26 15:13:20.015786 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 319/639] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:19 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:20.514714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:20.515322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:20.522984 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:20.523436 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:20.524229 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:20.524671 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:20.759764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:20.768615 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:20.770289 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:20.771464 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-eae55b6f-c878-41e8-a403-c19233eb8d1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.260991 May 26 15:13:20.771980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 321/640] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:20 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:21.032683 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0f95d2e2-6c29-475c-9793-f26188833a8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:21.033243 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0f95d2e2-6c29-475c-9793-f26188833a8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:21.039691 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f95d2e2-6c29-475c-9793-f26188833a8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:21.040152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f95d2e2-6c29-475c-9793-f26188833a8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:21.040893 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f95d2e2-6c29-475c-9793-f26188833a8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:21.041325 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f95d2e2-6c29-475c-9793-f26188833a8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:21.102171 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0f95d2e2-6c29-475c-9793-f26188833a8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.110130 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0f95d2e2-6c29-475c-9793-f26188833a8c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1293 microversion: 2.1 time: 0.081966 May 26 15:13:21.110693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 320/641] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:21 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:21.789889 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:21.790536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:21.797909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:21.798360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:21.799126 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:21.799561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:21.945295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.953918 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.955445 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:21.956555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-17c43a1e-2232-49ae-b0d0-7ef274fcc658 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.170698 May 26 15:13:21.957119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 322/642] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:21 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:22.129667 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1292f504-479a-4fde-9845-f2f0fc26101e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:22.130396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1292f504-479a-4fde-9845-f2f0fc26101e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:22.142962 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1292f504-479a-4fde-9845-f2f0fc26101e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.143966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1292f504-479a-4fde-9845-f2f0fc26101e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.145343 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1292f504-479a-4fde-9845-f2f0fc26101e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.146581 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1292f504-479a-4fde-9845-f2f0fc26101e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.308547 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1292f504-479a-4fde-9845-f2f0fc26101e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:22.317640 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1292f504-479a-4fde-9845-f2f0fc26101e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.193027 May 26 15:13:22.318234 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 321/643] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:22 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:22.975083 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:22.975870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:22.984227 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.984930 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:22.985840 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:22.986374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.069966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-b7235cae-4310-4230-b1fd-95a5e58c15b8 req-cfa45d3b-f47f-44d5-b91a-daa52b27fe99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbe7683-005d-4728-8dcd-743fb3fc8a2b", "tag": "1cbb80ed-1bc4-49d4-9c28-74651ada43c4"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:23.080740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-b7235cae-4310-4230-b1fd-95a5e58c15b8 req-cfa45d3b-f47f-44d5-b91a-daa52b27fe99 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.081852 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-b7235cae-4310-4230-b1fd-95a5e58c15b8 req-cfa45d3b-f47f-44d5-b91a-daa52b27fe99 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.096366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-b7235cae-4310-4230-b1fd-95a5e58c15b8 req-cfa45d3b-f47f-44d5-b91a-daa52b27fe99 service nova] Creating event network-changed:1cbb80ed-1bc4-49d4-9c28-74651ada43c4 for instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b on hv-cinder-78836 May 26 15:13:23.102471 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-b7235cae-4310-4230-b1fd-95a5e58c15b8 req-cfa45d3b-f47f-44d5-b91a-daa52b27fe99 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036819 May 26 15:13:23.103094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 322/644] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:23.146324 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:23.155220 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:23.157966 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:23.161232 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-31c38293-4c57-4142-9636-a061ab64cfec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.188411 May 26 15:13:23.161870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 323/645] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:22 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:23.337643 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5d054c80-e067-461b-83ac-7683dde1b3d3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:23.338356 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5d054c80-e067-461b-83ac-7683dde1b3d3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:23.348036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d054c80-e067-461b-83ac-7683dde1b3d3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.348825 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d054c80-e067-461b-83ac-7683dde1b3d3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.349867 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d054c80-e067-461b-83ac-7683dde1b3d3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:23.350458 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d054c80-e067-461b-83ac-7683dde1b3d3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:23.515038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5d054c80-e067-461b-83ac-7683dde1b3d3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:23.522718 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5d054c80-e067-461b-83ac-7683dde1b3d3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.190269 May 26 15:13:23.523438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 323/646] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:23 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:24.146618 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-d83863f3-af99-4144-9fb0-1510b6aff033 req-6b55361b-78de-4482-b377-00c8c7b3cf7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399eff3a-ae28-4b3d-a00c-36e004e509da", "name": "network-vif-plugged", "status": "completed", "tag": "f7a772e1-226c-4379-8092-198295987b70"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:24.159296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-d83863f3-af99-4144-9fb0-1510b6aff033 req-6b55361b-78de-4482-b377-00c8c7b3cf7d service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.160463 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-d83863f3-af99-4144-9fb0-1510b6aff033 req-6b55361b-78de-4482-b377-00c8c7b3cf7d service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.184386 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:24.186134 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-d83863f3-af99-4144-9fb0-1510b6aff033 req-6b55361b-78de-4482-b377-00c8c7b3cf7d service nova] Creating event network-vif-plugged:f7a772e1-226c-4379-8092-198295987b70 for instance 399eff3a-ae28-4b3d-a00c-36e004e509da on hv-cinder-78836 May 26 15:13:24.186375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:24.195010 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-d83863f3-af99-4144-9fb0-1510b6aff033 req-6b55361b-78de-4482-b377-00c8c7b3cf7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051735 May 26 15:13:24.198002 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 324/647] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:24.200978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.202280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.203239 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.203802 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.340986 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.349994 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.351494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.352586 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e0052fd2-6889-40f5-95fc-564fd938dd30 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.175861 May 26 15:13:24.353146 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 324/648] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:24 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:24.540958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-60d9283f-4b3f-4f67-a09d-5ad082065e15 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:24.541755 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-60d9283f-4b3f-4f67-a09d-5ad082065e15 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:24.548152 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60d9283f-4b3f-4f67-a09d-5ad082065e15 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.548597 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60d9283f-4b3f-4f67-a09d-5ad082065e15 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.549347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60d9283f-4b3f-4f67-a09d-5ad082065e15 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:24.549803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60d9283f-4b3f-4f67-a09d-5ad082065e15 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:24.678656 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-60d9283f-4b3f-4f67-a09d-5ad082065e15 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:24.686605 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-60d9283f-4b3f-4f67-a09d-5ad082065e15 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.150106 May 26 15:13:24.687191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 325/649] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:24 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:25.370827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:25.371555 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:25.378632 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.379077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.379847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.380278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.523173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:25.532023 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:25.533606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:25.534735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f4961bc1-9ed6-4cf1-968c-324585076b84 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.168121 May 26 15:13:25.535301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 325/650] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:25 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:13:25.704097 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-594ee483-0839-4ab0-a574-783cc3db5ec1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:25.704696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-594ee483-0839-4ab0-a574-783cc3db5ec1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:25.711324 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-594ee483-0839-4ab0-a574-783cc3db5ec1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.711769 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-594ee483-0839-4ab0-a574-783cc3db5ec1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.712539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-594ee483-0839-4ab0-a574-783cc3db5ec1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:25.712981 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-594ee483-0839-4ab0-a574-783cc3db5ec1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:25.854666 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-594ee483-0839-4ab0-a574-783cc3db5ec1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:25.857125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:25.863539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-594ee483-0839-4ab0-a574-783cc3db5ec1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.163967 May 26 15:13:25.864123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 326/651] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:25 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:26.552687 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:26.553372 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:26.562173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:26.562621 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:26.563394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:26.563836 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:26.702482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:26.711112 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:26.712510 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:26.713669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ca693e24-9f65-4cb8-b587-fbad8eab7762 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.164880 May 26 15:13:26.714301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 326/652] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:26 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:26.881281 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2d798ff1-35e9-4351-9059-8ddf31262697 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:26.881845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2d798ff1-35e9-4351-9059-8ddf31262697 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:26.889746 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d798ff1-35e9-4351-9059-8ddf31262697 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:26.890193 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d798ff1-35e9-4351-9059-8ddf31262697 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:26.890969 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d798ff1-35e9-4351-9059-8ddf31262697 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:26.891407 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d798ff1-35e9-4351-9059-8ddf31262697 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.044437 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2d798ff1-35e9-4351-9059-8ddf31262697 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:27.053733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2d798ff1-35e9-4351-9059-8ddf31262697 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.176452 May 26 15:13:27.054306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 327/653] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:26 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:27.732184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:27.732735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:27.739242 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:27.739694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.740448 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:27.740879 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:27.874941 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:27.883183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:27.884706 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:27.885856 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c9062ca7-db86-4557-af4a-8129d1e2c5d0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.158041 May 26 15:13:27.886421 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 327/654] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:27 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:28.070865 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b2279da3-43d2-4504-a4df-e6517c504f9f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:28.071461 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b2279da3-43d2-4504-a4df-e6517c504f9f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:28.080336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2279da3-43d2-4504-a4df-e6517c504f9f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:28.080802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2279da3-43d2-4504-a4df-e6517c504f9f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:28.081654 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2279da3-43d2-4504-a4df-e6517c504f9f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:28.082101 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b2279da3-43d2-4504-a4df-e6517c504f9f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:28.226566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b2279da3-43d2-4504-a4df-e6517c504f9f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:28.234311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b2279da3-43d2-4504-a4df-e6517c504f9f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.167264 May 26 15:13:28.234917 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 328/655] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:28 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:28.903474 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:28.904023 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:28.911604 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:28.912060 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:28.912842 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:28.913287 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:29.048166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:29.056644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:29.058436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:29.059651 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-716876e1-ae0c-4e01-b040-be41940711c2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.160082 May 26 15:13:29.060299 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 328/656] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:28 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:29.251637 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f8c4544d-1c4d-4432-a160-6e29694f7607 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:29.252250 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f8c4544d-1c4d-4432-a160-6e29694f7607 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:29.258829 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8c4544d-1c4d-4432-a160-6e29694f7607 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:29.259274 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8c4544d-1c4d-4432-a160-6e29694f7607 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:29.260037 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8c4544d-1c4d-4432-a160-6e29694f7607 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:29.260470 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f8c4544d-1c4d-4432-a160-6e29694f7607 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:29.392199 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f8c4544d-1c4d-4432-a160-6e29694f7607 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:29.399606 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f8c4544d-1c4d-4432-a160-6e29694f7607 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.151721 May 26 15:13:29.400179 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 329/657] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:29 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:30.079984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:30.080612 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:30.083142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=6 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:30.088348 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:30.088793 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:30.089593 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:30.090027 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:30.225757 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:30.229207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:30.235183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:30.236696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:30.237888 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a9a95db0-19b8-4303-950d-78099d30c4b0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.162553 May 26 15:13:30.238450 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 329/658] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:30 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:30.416986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-645914f0-ba35-43fa-a398-f9de2ea736ba tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:30.417558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-645914f0-ba35-43fa-a398-f9de2ea736ba tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:30.419428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=4 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:30.420588 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=18 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:30.426933 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-645914f0-ba35-43fa-a398-f9de2ea736ba tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:30.427702 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-645914f0-ba35-43fa-a398-f9de2ea736ba tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:30.428480 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-645914f0-ba35-43fa-a398-f9de2ea736ba tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:30.428920 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-645914f0-ba35-43fa-a398-f9de2ea736ba tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:30.559324 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-645914f0-ba35-43fa-a398-f9de2ea736ba tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:30.567818 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-645914f0-ba35-43fa-a398-f9de2ea736ba tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.154716 May 26 15:13:30.568406 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 330/659] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:30 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:31.256218 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:31.256944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:31.263548 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:31.264002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:31.265279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:31.265748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:31.413351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:31.422070 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:31.423603 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:31.424767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b54f0f67-4b14-4ad9-aae9-17d310823d13 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.172512 May 26 15:13:31.425594 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 330/660] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:31 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:31.585640 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-10e3eb47-019b-44de-9bde-debe571b893b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:31.586258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-10e3eb47-019b-44de-9bde-debe571b893b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:31.593116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10e3eb47-019b-44de-9bde-debe571b893b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:31.593600 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10e3eb47-019b-44de-9bde-debe571b893b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:31.594367 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10e3eb47-019b-44de-9bde-debe571b893b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:31.594804 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-10e3eb47-019b-44de-9bde-debe571b893b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:31.738018 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-10e3eb47-019b-44de-9bde-debe571b893b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:31.746410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-10e3eb47-019b-44de-9bde-debe571b893b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.164611 May 26 15:13:31.747041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 331/661] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:31 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:32.443193 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:32.443798 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:32.450582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:32.451028 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:32.451794 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:32.452281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:32.593894 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:32.602213 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:32.603770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:32.604926 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-34f61251-2642-4e7b-a1cd-656952ca6faf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1405 microversion: 2.20 time: 0.165646 May 26 15:13:32.605703 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 331/662] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:32 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:32.764295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cff07727-ae1b-4cc9-abe9-5fa7bbbfc976 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:32.764904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cff07727-ae1b-4cc9-abe9-5fa7bbbfc976 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:32.771331 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cff07727-ae1b-4cc9-abe9-5fa7bbbfc976 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:32.771774 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cff07727-ae1b-4cc9-abe9-5fa7bbbfc976 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:32.772539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cff07727-ae1b-4cc9-abe9-5fa7bbbfc976 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:32.772957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cff07727-ae1b-4cc9-abe9-5fa7bbbfc976 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:32.911949 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cff07727-ae1b-4cc9-abe9-5fa7bbbfc976 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:32.919352 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cff07727-ae1b-4cc9-abe9-5fa7bbbfc976 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.159025 May 26 15:13:32.919943 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 332/663] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:32 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:33.264847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-4403df2c-211e-4418-bcec-a69a6563baa9 req-8e64c5a0-2c7b-4e01-afe2-753bb45b3cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbe7683-005d-4728-8dcd-743fb3fc8a2b", "name": "network-vif-plugged", "status": "completed", "tag": "1cbb80ed-1bc4-49d4-9c28-74651ada43c4"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:33.273803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-4403df2c-211e-4418-bcec-a69a6563baa9 req-8e64c5a0-2c7b-4e01-afe2-753bb45b3cc8 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.274252 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-4403df2c-211e-4418-bcec-a69a6563baa9 req-8e64c5a0-2c7b-4e01-afe2-753bb45b3cc8 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:33.287076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-4403df2c-211e-4418-bcec-a69a6563baa9 req-8e64c5a0-2c7b-4e01-afe2-753bb45b3cc8 service nova] Creating event network-vif-plugged:1cbb80ed-1bc4-49d4-9c28-74651ada43c4 for instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b on hv-cinder-78836 May 26 15:13:33.292014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-4403df2c-211e-4418-bcec-a69a6563baa9 req-8e64c5a0-2c7b-4e01-afe2-753bb45b3cc8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030938 May 26 15:13:33.292609 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 332/664] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:33.624553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:33.625484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:33.632534 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.632994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:33.634007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.634258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:33.765320 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:33.775008 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:33.776527 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:33.777705 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-91fd8fca-9718-4f18-9a10-2023b2868a4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1597 microversion: 2.20 time: 0.157988 May 26 15:13:33.778269 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 333/665] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:13:33 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:13:33.796621 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-95ae09b5-b4b7-4fcc-b0e0-ec961f74c2e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:33.797210 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-95ae09b5-b4b7-4fcc-b0e0-ec961f74c2e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:33.803710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95ae09b5-b4b7-4fcc-b0e0-ec961f74c2e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.804156 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95ae09b5-b4b7-4fcc-b0e0-ec961f74c2e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:33.804981 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95ae09b5-b4b7-4fcc-b0e0-ec961f74c2e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.805418 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95ae09b5-b4b7-4fcc-b0e0-ec961f74c2e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:33.893398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-95ae09b5-b4b7-4fcc-b0e0-ec961f74c2e7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101584 May 26 15:13:33.894117 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 333/666] 10.222.0.46 () {60 vars in 1315 bytes} [Thu May 26 15:13:33 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:13:33.937137 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ecb7cbed-dccc-4c95-9746-b94a4cfab534 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:33.937690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ecb7cbed-dccc-4c95-9746-b94a4cfab534 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:33.945412 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ecb7cbed-dccc-4c95-9746-b94a4cfab534 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.945890 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ecb7cbed-dccc-4c95-9746-b94a4cfab534 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:33.946665 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ecb7cbed-dccc-4c95-9746-b94a4cfab534 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:33.947190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ecb7cbed-dccc-4c95-9746-b94a4cfab534 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:34.216988 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ecb7cbed-dccc-4c95-9746-b94a4cfab534 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:34.224628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ecb7cbed-dccc-4c95-9746-b94a4cfab534 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1366 microversion: 2.1 time: 0.292106 May 26 15:13:34.225204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 334/667] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:33 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:35.242090 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4e942e23-b6d0-44e9-8f10-38897166b74e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:35.243216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4e942e23-b6d0-44e9-8f10-38897166b74e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:35.253771 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4e942e23-b6d0-44e9-8f10-38897166b74e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.254620 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4e942e23-b6d0-44e9-8f10-38897166b74e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.255818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4e942e23-b6d0-44e9-8f10-38897166b74e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.256518 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4e942e23-b6d0-44e9-8f10-38897166b74e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.275906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-88d67939-4bf1-4350-938e-9981857ae747 req-0d362799-f082-4c70-b5d4-a5acbdb26dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "399eff3a-ae28-4b3d-a00c-36e004e509da", "tag": "f7a772e1-226c-4379-8092-198295987b70"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:35.284603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-88d67939-4bf1-4350-938e-9981857ae747 req-0d362799-f082-4c70-b5d4-a5acbdb26dcf service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.285049 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-88d67939-4bf1-4350-938e-9981857ae747 req-0d362799-f082-4c70-b5d4-a5acbdb26dcf service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.297213 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-88d67939-4bf1-4350-938e-9981857ae747 req-0d362799-f082-4c70-b5d4-a5acbdb26dcf service nova] Creating event network-changed:f7a772e1-226c-4379-8092-198295987b70 for instance 399eff3a-ae28-4b3d-a00c-36e004e509da on hv-cinder-78836 May 26 15:13:35.303089 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-88d67939-4bf1-4350-938e-9981857ae747 req-0d362799-f082-4c70-b5d4-a5acbdb26dcf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030782 May 26 15:13:35.303733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 335/668] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:13:35.395250 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4e942e23-b6d0-44e9-8f10-38897166b74e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:35.402864 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4e942e23-b6d0-44e9-8f10-38897166b74e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1557 microversion: 2.1 time: 0.165082 May 26 15:13:35.403672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 334/669] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:35 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:35.422489 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6393fc3e-b1d9-4305-ac4b-547edf8d7afa tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:35.422845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6393fc3e-b1d9-4305-ac4b-547edf8d7afa tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:35.429078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6393fc3e-b1d9-4305-ac4b-547edf8d7afa tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.429557 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6393fc3e-b1d9-4305-ac4b-547edf8d7afa tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.430318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6393fc3e-b1d9-4305-ac4b-547edf8d7afa tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.430751 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6393fc3e-b1d9-4305-ac4b-547edf8d7afa tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.513173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6393fc3e-b1d9-4305-ac4b-547edf8d7afa tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095812 May 26 15:13:35.513877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 336/670] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 15:13:35 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:35.679373 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8afd02b1-bee4-4ad6-beee-d2b9f13b59b2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:35.680810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8afd02b1-bee4-4ad6-beee-d2b9f13b59b2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:35.687782 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8afd02b1-bee4-4ad6-beee-d2b9f13b59b2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.688318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8afd02b1-bee4-4ad6-beee-d2b9f13b59b2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.689156 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8afd02b1-bee4-4ad6-beee-d2b9f13b59b2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:35.689884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8afd02b1-bee4-4ad6-beee-d2b9f13b59b2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:35.783263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-8afd02b1-bee4-4ad6-beee-d2b9f13b59b2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lazy-loading 'services' on Instance uuid 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:13:35.871636 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8afd02b1-bee4-4ad6-beee-d2b9f13b59b2 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773/os-volume_attachments/10bd3dbb-7f10-4d05-8497-1e58325a10ac" status: 202 len: 0 microversion: 2.1 time: 0.195483 May 26 15:13:35.872477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 335/671] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:13:35 2022] DELETE /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773/os-volume_attachments/10bd3dbb-7f10-4d05-8497-1e58325a10ac => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:13:37.318286 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-3cca4b43-8de0-4c53-8504-cd16e74b36e2 req-66db9b95-0777-4abd-939b-9edd45dc240c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbe7683-005d-4728-8dcd-743fb3fc8a2b", "tag": "1cbb80ed-1bc4-49d4-9c28-74651ada43c4"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:37.326410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-3cca4b43-8de0-4c53-8504-cd16e74b36e2 req-66db9b95-0777-4abd-939b-9edd45dc240c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:37.327460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-3cca4b43-8de0-4c53-8504-cd16e74b36e2 req-66db9b95-0777-4abd-939b-9edd45dc240c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:37.339522 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-3cca4b43-8de0-4c53-8504-cd16e74b36e2 req-66db9b95-0777-4abd-939b-9edd45dc240c service nova] Creating event network-changed:1cbb80ed-1bc4-49d4-9c28-74651ada43c4 for instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b on hv-cinder-78836 May 26 15:13:37.344473 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-3cca4b43-8de0-4c53-8504-cd16e74b36e2 req-66db9b95-0777-4abd-939b-9edd45dc240c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030464 May 26 15:13:37.345082 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 337/672] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:38.087991 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-cc43bc40-b363-40f4-b675-1b5117f3cdfd tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:38.088573 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cc43bc40-b363-40f4-b675-1b5117f3cdfd tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:38.097863 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cc43bc40-b363-40f4-b675-1b5117f3cdfd tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:38.098325 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cc43bc40-b363-40f4-b675-1b5117f3cdfd tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:38.099104 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cc43bc40-b363-40f4-b675-1b5117f3cdfd tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:38.099546 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cc43bc40-b363-40f4-b675-1b5117f3cdfd tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:38.126245 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cc43bc40-b363-40f4-b675-1b5117f3cdfd tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:13:38.207660 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-cc43bc40-b363-40f4-b675-1b5117f3cdfd tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 204 len: 0 microversion: 2.1 time: 0.123588 May 26 15:13:38.208436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 336/673] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:13:38 2022] DELETE /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:13:38.217195 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0973df72-6a99-457f-8725-bbbdc2c1ade9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:38.218533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0973df72-6a99-457f-8725-bbbdc2c1ade9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:38.227176 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0973df72-6a99-457f-8725-bbbdc2c1ade9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:38.228052 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0973df72-6a99-457f-8725-bbbdc2c1ade9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:38.228852 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0973df72-6a99-457f-8725-bbbdc2c1ade9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:38.229502 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0973df72-6a99-457f-8725-bbbdc2c1ade9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:38.371866 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0973df72-6a99-457f-8725-bbbdc2c1ade9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:38.379440 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0973df72-6a99-457f-8725-bbbdc2c1ade9 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1514 microversion: 2.1 time: 0.166456 May 26 15:13:38.379946 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 338/674] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:38 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:38.445650 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-82754a9a-0046-4219-999e-5edadf886cd5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a1633ec-6002-4edb-b4c3-f1601769f915"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:38.446856 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-82754a9a-0046-4219-999e-5edadf886cd5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:38.453760 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-82754a9a-0046-4219-999e-5edadf886cd5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:38.454205 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-82754a9a-0046-4219-999e-5edadf886cd5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:38.454968 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-82754a9a-0046-4219-999e-5edadf886cd5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:38.455398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-82754a9a-0046-4219-999e-5edadf886cd5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:39.396238 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d522123f-d404-47d4-b563-72fa60c2ffdc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:39.396857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d522123f-d404-47d4-b563-72fa60c2ffdc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:39.403528 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d522123f-d404-47d4-b563-72fa60c2ffdc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:39.403969 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d522123f-d404-47d4-b563-72fa60c2ffdc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:39.404734 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d522123f-d404-47d4-b563-72fa60c2ffdc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:39.405174 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d522123f-d404-47d4-b563-72fa60c2ffdc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:39.535044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d522123f-d404-47d4-b563-72fa60c2ffdc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:39.542656 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d522123f-d404-47d4-b563-72fa60c2ffdc tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1514 microversion: 2.1 time: 0.150301 May 26 15:13:39.543214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 339/675] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:39 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:40.212204 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-82754a9a-0046-4219-999e-5edadf886cd5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.770941 May 26 15:13:40.213030 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 337/676] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:13:38 2022] POST /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments => generated 194 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:13:40.559713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d6e28605-4a24-488a-98d8-8caacedea16e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:40.560335 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d6e28605-4a24-488a-98d8-8caacedea16e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:40.567106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d6e28605-4a24-488a-98d8-8caacedea16e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:40.567565 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d6e28605-4a24-488a-98d8-8caacedea16e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:40.568348 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d6e28605-4a24-488a-98d8-8caacedea16e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:40.568790 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d6e28605-4a24-488a-98d8-8caacedea16e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:40.713843 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d6e28605-4a24-488a-98d8-8caacedea16e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:40.721838 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d6e28605-4a24-488a-98d8-8caacedea16e tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1514 microversion: 2.1 time: 0.165921 May 26 15:13:40.722434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 340/677] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:40 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:41.002361 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-f9a0cc15-b7ec-4085-8a48-cc3b36f16989 req-8cb41671-02ef-4318-a4bc-d7c3305912e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ffad3c3-bb0f-4e23-a684-2d87d0e05773", "name": "network-vif-deleted", "tag": "3ffef797-bf12-45a3-bd7a-eb5cf65d8a6a"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:41.011386 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-f9a0cc15-b7ec-4085-8a48-cc3b36f16989 req-8cb41671-02ef-4318-a4bc-d7c3305912e1 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:41.011839 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-f9a0cc15-b7ec-4085-8a48-cc3b36f16989 req-8cb41671-02ef-4318-a4bc-d7c3305912e1 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:41.023696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-f9a0cc15-b7ec-4085-8a48-cc3b36f16989 req-8cb41671-02ef-4318-a4bc-d7c3305912e1 service nova] Creating event network-vif-deleted:3ffef797-bf12-45a3-bd7a-eb5cf65d8a6a for instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 on hv-cinder-78836 May 26 15:13:41.028629 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-f9a0cc15-b7ec-4085-8a48-cc3b36f16989 req-8cb41671-02ef-4318-a4bc-d7c3305912e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031475 May 26 15:13:41.029326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 338/678] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:41.740424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:41.741060 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:41.747702 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:41.748150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:41.749669 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:41.750103 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:41.782428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:41.782880 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:41.783339 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lazy-loading 'fault' on Instance uuid 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:13:41.828263 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa425e42202421c9e1c8564456c67f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58410e922bd46418c9e93bf61b348f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:41.836580 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-06f68e4c-7ab9-41b4-ad6c-4b02a5a5af27 tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 200 len: 1309 microversion: 2.1 time: 0.100811 May 26 15:13:41.837205 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 341/679] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:41 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:42.855674 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:42.856400 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] [instance: 5ffad3c3-bb0f-4e23-a684-2d87d0e05773] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:42.862818 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:42.863265 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:42.864169 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:42.864575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:42.878927 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] HTTP exception thrown: Instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 could not be found. May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Request method failure captured: May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 HTTP/1.1 May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5iWABEljxZ37wEbIvSQifrgnX-v5bM4fZenZcmDNgal59l0pDKFz7IvVOMOYHDfSEs-DN-INcgKEaZ0BO2yfY2mdnwgG0MuhQZde-C2Sl-pz2oTw_EE8Op3skgFh_ZYv7infXNIEHaLKk-ZzX-BJvHaxxoRaE-Xo0UyGtMdKIPXSjk May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: d58410e922bd46418c9e93bf61b348f8 May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesSnapshotTestJSON-505900774 May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:13:42.880589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d58410e922bd46418c9e93bf61b348f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d58410e922bd46418c9e93bf61b348f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d58410e922bd46418c9e93bf61b348f8", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d58410e922bd46418c9e93bf61b348f8"}]}] May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesSnapshotTestJSON-505900774 May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: d58410e922bd46418c9e93bf61b348f8 May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-505900774 May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesSnapshotTestJSON-505900774-project May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: dfa425e42202421c9e1c8564456c67f7 May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesSnapshotTestJSON-505900774-project May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 could not be found. May 26 15:13:42.882167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '5ffad3c3-bb0f-4e23-a684-2d87d0e05773'} May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 could not be found. May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:13:42.883059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 could not be found. May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 could not be found. May 26 15:13:42.884276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:13:42.885349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] Returning 404 to user: Instance 5ffad3c3-bb0f-4e23-a684-2d87d0e05773 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:13:42.885349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6dc507b8-9694-4b84-aeec-b5bafc18052f tempest-VolumesSnapshotTestJSON-505900774 tempest-VolumesSnapshotTestJSON-505900774-project] 10.222.0.46 "GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773" status: 404 len: 111 microversion: 2.1 time: 0.031341 May 26 15:13:42.885349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 339/680] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:42 2022] GET /compute/v2.1/servers/5ffad3c3-bb0f-4e23-a684-2d87d0e05773 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:13:43.504597 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a94fccbd-48b9-43ec-b838-b1fe7ee83b1e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:43.505661 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a94fccbd-48b9-43ec-b838-b1fe7ee83b1e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:43.512183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a94fccbd-48b9-43ec-b838-b1fe7ee83b1e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.512637 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a94fccbd-48b9-43ec-b838-b1fe7ee83b1e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.513400 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a94fccbd-48b9-43ec-b838-b1fe7ee83b1e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.513876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a94fccbd-48b9-43ec-b838-b1fe7ee83b1e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.537709 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-a94fccbd-48b9-43ec-b838-b1fe7ee83b1e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lazy-loading 'flavor' on Instance uuid 4682a8fb-1ed3-492f-963e-7befa1cf839d {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:13:43.656729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:43.667129 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a94fccbd-48b9-43ec-b838-b1fe7ee83b1e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/action" status: 200 len: 32 microversion: 2.1 time: 0.166015 May 26 15:13:43.667316 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 342/681] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:13:43 2022] POST /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:13:43.676870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f9b36aef-ff9d-4604-89cc-45f4dcee42ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:43.677669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f9b36aef-ff9d-4604-89cc-45f4dcee42ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:43.684170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f9b36aef-ff9d-4604-89cc-45f4dcee42ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.684631 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f9b36aef-ff9d-4604-89cc-45f4dcee42ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.685411 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f9b36aef-ff9d-4604-89cc-45f4dcee42ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:43.685896 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f9b36aef-ff9d-4604-89cc-45f4dcee42ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:43.830139 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f9b36aef-ff9d-4604-89cc-45f4dcee42ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:43.839394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f9b36aef-ff9d-4604-89cc-45f4dcee42ec tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.166324 May 26 15:13:43.839979 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 340/682] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:43 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:44.859189 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5a270b5d-c392-49b7-b955-010c069b1348 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:44.859903 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5a270b5d-c392-49b7-b955-010c069b1348 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:44.866300 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a270b5d-c392-49b7-b955-010c069b1348 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:44.866762 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a270b5d-c392-49b7-b955-010c069b1348 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:44.867536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a270b5d-c392-49b7-b955-010c069b1348 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:44.867978 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5a270b5d-c392-49b7-b955-010c069b1348 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:45.018536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5a270b5d-c392-49b7-b955-010c069b1348 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:45.027766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5a270b5d-c392-49b7-b955-010c069b1348 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.173915 May 26 15:13:45.028349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 343/683] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:44 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:46.045514 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-021ff40f-9765-4d1c-b284-55ad8a2f7928 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:46.046127 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-021ff40f-9765-4d1c-b284-55ad8a2f7928 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:46.048543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:46.054559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-021ff40f-9765-4d1c-b284-55ad8a2f7928 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:46.055110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-021ff40f-9765-4d1c-b284-55ad8a2f7928 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:46.056008 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-021ff40f-9765-4d1c-b284-55ad8a2f7928 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:46.056440 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-021ff40f-9765-4d1c-b284-55ad8a2f7928 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:46.190995 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-021ff40f-9765-4d1c-b284-55ad8a2f7928 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:46.199116 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-021ff40f-9765-4d1c-b284-55ad8a2f7928 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.157504 May 26 15:13:46.199677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 341/684] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:46 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:47.219078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-75a3344d-a535-4c84-881d-e29bc6b6496e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:47.219702 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-75a3344d-a535-4c84-881d-e29bc6b6496e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:47.226627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75a3344d-a535-4c84-881d-e29bc6b6496e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:47.227089 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75a3344d-a535-4c84-881d-e29bc6b6496e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:47.227871 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75a3344d-a535-4c84-881d-e29bc6b6496e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:47.228311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75a3344d-a535-4c84-881d-e29bc6b6496e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:47.368402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-75a3344d-a535-4c84-881d-e29bc6b6496e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:47.376672 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-75a3344d-a535-4c84-881d-e29bc6b6496e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.163636 May 26 15:13:47.377233 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 344/685] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:47 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:48.394247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9eb92c48-7296-46f5-8ee1-45e5743a8448 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:48.394863 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9eb92c48-7296-46f5-8ee1-45e5743a8448 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:48.401559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9eb92c48-7296-46f5-8ee1-45e5743a8448 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:48.402016 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9eb92c48-7296-46f5-8ee1-45e5743a8448 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:48.402790 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9eb92c48-7296-46f5-8ee1-45e5743a8448 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:48.403230 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9eb92c48-7296-46f5-8ee1-45e5743a8448 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:48.596166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9eb92c48-7296-46f5-8ee1-45e5743a8448 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:48.604570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9eb92c48-7296-46f5-8ee1-45e5743a8448 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.214742 May 26 15:13:48.605351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 342/686] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:48 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:49.626863 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-98ceb33b-1ff8-4526-9264-94b0e71b394b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:49.627855 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-98ceb33b-1ff8-4526-9264-94b0e71b394b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:49.638802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-98ceb33b-1ff8-4526-9264-94b0e71b394b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:49.639497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-98ceb33b-1ff8-4526-9264-94b0e71b394b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:49.641212 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-98ceb33b-1ff8-4526-9264-94b0e71b394b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:49.641929 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-98ceb33b-1ff8-4526-9264-94b0e71b394b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:49.779950 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-98ceb33b-1ff8-4526-9264-94b0e71b394b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:49.788007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-98ceb33b-1ff8-4526-9264-94b0e71b394b tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.169169 May 26 15:13:49.788591 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 345/687] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:49 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:50.806070 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ba187e20-90fe-47c7-b0b6-b96abff83fb5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:50.806722 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ba187e20-90fe-47c7-b0b6-b96abff83fb5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:50.813992 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ba187e20-90fe-47c7-b0b6-b96abff83fb5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:50.814447 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ba187e20-90fe-47c7-b0b6-b96abff83fb5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:50.815234 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ba187e20-90fe-47c7-b0b6-b96abff83fb5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:50.815682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ba187e20-90fe-47c7-b0b6-b96abff83fb5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:50.975475 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ba187e20-90fe-47c7-b0b6-b96abff83fb5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:50.984038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ba187e20-90fe-47c7-b0b6-b96abff83fb5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.181775 May 26 15:13:50.984646 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 343/688] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:50 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:52.001679 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a6122a2e-c7ec-4df5-9391-fce193ad6583 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:52.002247 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a6122a2e-c7ec-4df5-9391-fce193ad6583 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:52.004803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:52.011059 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6122a2e-c7ec-4df5-9391-fce193ad6583 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:52.011638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6122a2e-c7ec-4df5-9391-fce193ad6583 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:52.012440 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6122a2e-c7ec-4df5-9391-fce193ad6583 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:52.012919 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a6122a2e-c7ec-4df5-9391-fce193ad6583 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:52.202767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a6122a2e-c7ec-4df5-9391-fce193ad6583 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:52.211088 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a6122a2e-c7ec-4df5-9391-fce193ad6583 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.213392 May 26 15:13:52.211714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 346/689] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:51 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:53.230001 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ba12f3ad-1346-4287-a1b1-52efaba563f1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:53.230740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ba12f3ad-1346-4287-a1b1-52efaba563f1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:53.237215 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ba12f3ad-1346-4287-a1b1-52efaba563f1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:53.237707 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ba12f3ad-1346-4287-a1b1-52efaba563f1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:53.238477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ba12f3ad-1346-4287-a1b1-52efaba563f1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:53.238910 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ba12f3ad-1346-4287-a1b1-52efaba563f1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:53.375521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ba12f3ad-1346-4287-a1b1-52efaba563f1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:53.383699 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ba12f3ad-1346-4287-a1b1-52efaba563f1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.157562 May 26 15:13:53.384274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 344/690] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:53 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:54.402137 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-36a47ec4-6eb4-4364-97e5-44ffff078511 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:54.402749 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-36a47ec4-6eb4-4364-97e5-44ffff078511 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:54.409832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36a47ec4-6eb4-4364-97e5-44ffff078511 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:54.410280 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36a47ec4-6eb4-4364-97e5-44ffff078511 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:54.411035 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36a47ec4-6eb4-4364-97e5-44ffff078511 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:54.411466 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-36a47ec4-6eb4-4364-97e5-44ffff078511 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:54.544881 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-36a47ec4-6eb4-4364-97e5-44ffff078511 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:54.553743 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-36a47ec4-6eb4-4364-97e5-44ffff078511 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.155455 May 26 15:13:54.554373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 347/691] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:54 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:55.572405 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b61b840c-824d-4033-a467-72674fb4c6f4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:55.573019 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b61b840c-824d-4033-a467-72674fb4c6f4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:55.580240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b61b840c-824d-4033-a467-72674fb4c6f4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:55.580689 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b61b840c-824d-4033-a467-72674fb4c6f4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:55.581473 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b61b840c-824d-4033-a467-72674fb4c6f4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:55.581919 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b61b840c-824d-4033-a467-72674fb4c6f4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:55.585951 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:13:55.713883 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b61b840c-824d-4033-a467-72674fb4c6f4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:55.721828 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b61b840c-824d-4033-a467-72674fb4c6f4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.153268 May 26 15:13:55.722401 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 345/692] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:55 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:56.739072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cb827bad-c43e-42da-90ef-799d518effca tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:56.739717 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cb827bad-c43e-42da-90ef-799d518effca tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:56.746504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb827bad-c43e-42da-90ef-799d518effca tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:56.746963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb827bad-c43e-42da-90ef-799d518effca tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:56.747732 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb827bad-c43e-42da-90ef-799d518effca tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:56.748168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb827bad-c43e-42da-90ef-799d518effca tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:56.886502 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cb827bad-c43e-42da-90ef-799d518effca tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:56.895118 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cb827bad-c43e-42da-90ef-799d518effca tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.159825 May 26 15:13:56.895703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 348/693] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:56 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:57.912435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-08504746-979f-4506-870f-40b76005ceb3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:57.913052 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-08504746-979f-4506-870f-40b76005ceb3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:57.919737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08504746-979f-4506-870f-40b76005ceb3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:57.920185 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08504746-979f-4506-870f-40b76005ceb3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:57.920944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08504746-979f-4506-870f-40b76005ceb3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:57.921383 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08504746-979f-4506-870f-40b76005ceb3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:58.053642 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-08504746-979f-4506-870f-40b76005ceb3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:58.061610 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-08504746-979f-4506-870f-40b76005ceb3 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.152981 May 26 15:13:58.062197 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 346/694] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:57 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:59.079578 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-07e37b33-cf7a-4911-9e30-4e2af3c9f864 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:59.080191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-07e37b33-cf7a-4911-9e30-4e2af3c9f864 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:13:59.086921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-07e37b33-cf7a-4911-9e30-4e2af3c9f864 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:59.087374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-07e37b33-cf7a-4911-9e30-4e2af3c9f864 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:59.088171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-07e37b33-cf7a-4911-9e30-4e2af3c9f864 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:13:59.088614 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-07e37b33-cf7a-4911-9e30-4e2af3c9f864 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:13:59.215590 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-07e37b33-cf7a-4911-9e30-4e2af3c9f864 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:59.223379 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-07e37b33-cf7a-4911-9e30-4e2af3c9f864 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.148409 May 26 15:13:59.223938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 349/695] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:13:59 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:00.240449 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-954193dd-66aa-4d2c-bbb4-093a22dde718 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:00.241071 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-954193dd-66aa-4d2c-bbb4-093a22dde718 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:00.247912 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-954193dd-66aa-4d2c-bbb4-093a22dde718 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:00.248374 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-954193dd-66aa-4d2c-bbb4-093a22dde718 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:00.249137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-954193dd-66aa-4d2c-bbb4-093a22dde718 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:00.249610 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-954193dd-66aa-4d2c-bbb4-093a22dde718 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:00.386094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-954193dd-66aa-4d2c-bbb4-093a22dde718 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:00.394500 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-954193dd-66aa-4d2c-bbb4-093a22dde718 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.158020 May 26 15:14:00.395053 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 347/696] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:00 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:01.412276 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-936a80d2-eefe-4ff0-864b-69aff7bddae9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:01.412948 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-936a80d2-eefe-4ff0-864b-69aff7bddae9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:01.419696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-936a80d2-eefe-4ff0-864b-69aff7bddae9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:01.420148 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-936a80d2-eefe-4ff0-864b-69aff7bddae9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:01.421528 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-936a80d2-eefe-4ff0-864b-69aff7bddae9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:01.422105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-936a80d2-eefe-4ff0-864b-69aff7bddae9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:01.562788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-936a80d2-eefe-4ff0-864b-69aff7bddae9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:01.573075 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-936a80d2-eefe-4ff0-864b-69aff7bddae9 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.164780 May 26 15:14:01.573877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 350/697] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:01 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:02.589901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d38944ab-758a-4f3f-b362-3e04d76446ae tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:02.590574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d38944ab-758a-4f3f-b362-3e04d76446ae tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:02.598544 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d38944ab-758a-4f3f-b362-3e04d76446ae tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:02.598999 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d38944ab-758a-4f3f-b362-3e04d76446ae tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:02.599816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d38944ab-758a-4f3f-b362-3e04d76446ae tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:02.600287 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d38944ab-758a-4f3f-b362-3e04d76446ae tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:02.754003 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d38944ab-758a-4f3f-b362-3e04d76446ae tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:02.762227 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d38944ab-758a-4f3f-b362-3e04d76446ae tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.176522 May 26 15:14:02.762777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 348/698] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:02 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:03.780810 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c6643de3-a005-4685-bd33-de8938845a0d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:03.781352 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c6643de3-a005-4685-bd33-de8938845a0d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:03.788072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c6643de3-a005-4685-bd33-de8938845a0d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:03.788527 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c6643de3-a005-4685-bd33-de8938845a0d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:03.789298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c6643de3-a005-4685-bd33-de8938845a0d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:03.789779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c6643de3-a005-4685-bd33-de8938845a0d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:03.923005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c6643de3-a005-4685-bd33-de8938845a0d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:03.931671 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c6643de3-a005-4685-bd33-de8938845a0d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.155323 May 26 15:14:03.932421 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 351/699] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:03 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:04.570333 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ce0e9541-bd39-439d-bbca-fc2f02029749 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:04.571309 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ce0e9541-bd39-439d-bbca-fc2f02029749 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:04.578408 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce0e9541-bd39-439d-bbca-fc2f02029749 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.578851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce0e9541-bd39-439d-bbca-fc2f02029749 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.579602 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce0e9541-bd39-439d-bbca-fc2f02029749 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.580035 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce0e9541-bd39-439d-bbca-fc2f02029749 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.609124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ce0e9541-bd39-439d-bbca-fc2f02029749 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042455 May 26 15:14:04.609917 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 349/700] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:14:04 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:14:04.672203 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d6142d60-68d5-43a4-97f6-35905ddc349a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:04.672703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d6142d60-68d5-43a4-97f6-35905ddc349a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:04.678843 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d6142d60-68d5-43a4-97f6-35905ddc349a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.679302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d6142d60-68d5-43a4-97f6-35905ddc349a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.680070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d6142d60-68d5-43a4-97f6-35905ddc349a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.680508 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d6142d60-68d5-43a4-97f6-35905ddc349a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.707729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d6142d60-68d5-43a4-97f6-35905ddc349a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:14:04.784638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d6142d60-68d5-43a4-97f6-35905ddc349a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 204 len: 0 microversion: 2.1 time: 0.116535 May 26 15:14:04.785550 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 352/701] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:14:04 2022] DELETE /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:14:04.793365 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-03114263-e06b-42fb-b22b-8b5fd093da2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:04.794119 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-03114263-e06b-42fb-b22b-8b5fd093da2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:04.800781 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-03114263-e06b-42fb-b22b-8b5fd093da2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.801236 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-03114263-e06b-42fb-b22b-8b5fd093da2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.802099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-03114263-e06b-42fb-b22b-8b5fd093da2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.802482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-03114263-e06b-42fb-b22b-8b5fd093da2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.940241 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-03114263-e06b-42fb-b22b-8b5fd093da2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:04.947866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-03114263-e06b-42fb-b22b-8b5fd093da2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1673 microversion: 2.1 time: 0.158314 May 26 15:14:04.948431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 350/702] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:04 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:04.949209 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6cc582cb-2141-4e54-9ec4-3703d7d9d21d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:04.949958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6cc582cb-2141-4e54-9ec4-3703d7d9d21d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:04.956426 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6cc582cb-2141-4e54-9ec4-3703d7d9d21d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.956886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6cc582cb-2141-4e54-9ec4-3703d7d9d21d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:04.957682 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6cc582cb-2141-4e54-9ec4-3703d7d9d21d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:04.958125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6cc582cb-2141-4e54-9ec4-3703d7d9d21d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:05.251510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6cc582cb-2141-4e54-9ec4-3703d7d9d21d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:05.259368 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6cc582cb-2141-4e54-9ec4-3703d7d9d21d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.314349 May 26 15:14:05.259921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 353/703] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:04 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:05.965791 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-dc9d5bde-9198-495e-ac2c-50e37abd2935 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:05.966353 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-dc9d5bde-9198-495e-ac2c-50e37abd2935 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:05.972878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-dc9d5bde-9198-495e-ac2c-50e37abd2935 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:05.973318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-dc9d5bde-9198-495e-ac2c-50e37abd2935 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:05.974100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-dc9d5bde-9198-495e-ac2c-50e37abd2935 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:05.974536 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-dc9d5bde-9198-495e-ac2c-50e37abd2935 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:06.104436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-dc9d5bde-9198-495e-ac2c-50e37abd2935 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:06.112012 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-dc9d5bde-9198-495e-ac2c-50e37abd2935 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1673 microversion: 2.1 time: 0.150357 May 26 15:14:06.112583 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 351/704] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:05 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:06.276895 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-aecc1c4e-ea34-4944-b53a-045e82d13182 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:06.277590 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-aecc1c4e-ea34-4944-b53a-045e82d13182 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:06.284240 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aecc1c4e-ea34-4944-b53a-045e82d13182 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:06.284782 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aecc1c4e-ea34-4944-b53a-045e82d13182 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:06.285483 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aecc1c4e-ea34-4944-b53a-045e82d13182 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:06.285926 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-aecc1c4e-ea34-4944-b53a-045e82d13182 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:06.661795 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-aecc1c4e-ea34-4944-b53a-045e82d13182 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:06.669736 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-aecc1c4e-ea34-4944-b53a-045e82d13182 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.396649 May 26 15:14:06.670296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 354/705] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:06 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:07.129593 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e3ad40e0-174e-419c-8521-09cfb0ceae6e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:07.130264 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e3ad40e0-174e-419c-8521-09cfb0ceae6e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:07.136591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3ad40e0-174e-419c-8521-09cfb0ceae6e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:07.137055 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3ad40e0-174e-419c-8521-09cfb0ceae6e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:07.137869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3ad40e0-174e-419c-8521-09cfb0ceae6e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:07.138312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3ad40e0-174e-419c-8521-09cfb0ceae6e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:07.313586 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e3ad40e0-174e-419c-8521-09cfb0ceae6e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:07.322513 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e3ad40e0-174e-419c-8521-09cfb0ceae6e tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1673 microversion: 2.1 time: 0.196810 May 26 15:14:07.328621 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 352/706] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:07 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:07.688941 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3a7e20a0-d120-4191-ac42-79c653ac19bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:07.691095 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3a7e20a0-d120-4191-ac42-79c653ac19bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:07.699809 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a7e20a0-d120-4191-ac42-79c653ac19bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:07.700852 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a7e20a0-d120-4191-ac42-79c653ac19bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:07.701735 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a7e20a0-d120-4191-ac42-79c653ac19bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:07.702209 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a7e20a0-d120-4191-ac42-79c653ac19bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:07.846245 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3a7e20a0-d120-4191-ac42-79c653ac19bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:07.854455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3a7e20a0-d120-4191-ac42-79c653ac19bc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.171451 May 26 15:14:07.855128 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 355/707] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:07 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:07.975584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-dfc6805f-f213-43a0-bba0-84b83f0b0ac3 req-1aaac4bf-a26c-4af7-882a-5ac08884bb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea4ff4a-0c29-465d-b388-d223fd508a69", "name": "network-vif-deleted", "tag": "7c1e2fa5-dc43-40be-953e-bee74f2af6fd"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:07.985924 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-dfc6805f-f213-43a0-bba0-84b83f0b0ac3 req-1aaac4bf-a26c-4af7-882a-5ac08884bb59 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:07.986653 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-dfc6805f-f213-43a0-bba0-84b83f0b0ac3 req-1aaac4bf-a26c-4af7-882a-5ac08884bb59 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:08.000553 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-dfc6805f-f213-43a0-bba0-84b83f0b0ac3 req-1aaac4bf-a26c-4af7-882a-5ac08884bb59 service nova] Creating event network-vif-deleted:7c1e2fa5-dc43-40be-953e-bee74f2af6fd for instance dea4ff4a-0c29-465d-b388-d223fd508a69 on hv-cinder-78836 May 26 15:14:08.005835 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-dfc6805f-f213-43a0-bba0-84b83f0b0ac3 req-1aaac4bf-a26c-4af7-882a-5ac08884bb59 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033878 May 26 15:14:08.006445 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 353/708] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:08.340709 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:08.341321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:08.348474 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:08.349168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:08.350126 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:08.350730 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:08.384448 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:08.384897 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:08.385346 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lazy-loading 'fault' on Instance uuid dea4ff4a-0c29-465d-b388-d223fd508a69 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:14:08.430904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:08.438790 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0632aa28-5d17-446a-a8ac-5f687549921d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 200 len: 1327 microversion: 2.1 time: 0.102256 May 26 15:14:08.439364 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 356/709] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:08 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:08.874101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-43843a8b-4b6f-469c-b6fb-15a6c9044558 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:08.874814 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-43843a8b-4b6f-469c-b6fb-15a6c9044558 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:08.881032 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-43843a8b-4b6f-469c-b6fb-15a6c9044558 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:08.881517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-43843a8b-4b6f-469c-b6fb-15a6c9044558 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:08.882296 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-43843a8b-4b6f-469c-b6fb-15a6c9044558 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:08.882737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-43843a8b-4b6f-469c-b6fb-15a6c9044558 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:09.026675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-43843a8b-4b6f-469c-b6fb-15a6c9044558 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:09.035168 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-43843a8b-4b6f-469c-b6fb-15a6c9044558 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.166728 May 26 15:14:09.035731 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 354/710] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:08 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:09.457908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:09.458586 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:09.465377 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:09.465860 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:09.466758 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:09.468114 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:09.482810 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] HTTP exception thrown: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Request method failure captured: May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 HTTP/1.1 May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gZVcOyO39b_xiNYQbkLarkzGT1otldshHhqmj-Snsh1fAjLhDiylhjLLvqHoi0moz_fHeDtqwqTgqJA2TJew1Ta4MWBqYwGp5jI2NrYWNAK2-NTmGnI8D8oo8C0a3Rah57eGqYqgiFkTcpOQ1Hs-KwBIAvh3-VpoVvn4HBv6s3CZs May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 0910873988084bc0becc79bb99febc96 May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:14:09.484659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0910873988084bc0becc79bb99febc96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0910873988084bc0becc79bb99febc96"}]}] May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeTestJSON-133946326 May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 0910873988084bc0becc79bb99febc96 May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeTestJSON-133946326-project May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: e95b6425286f4235b9d1802acddac4b8 May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeTestJSON-133946326-project May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:14:09.486295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': 'dea4ff4a-0c29-465d-b388-d223fd508a69'} May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:14:09.487254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:14:09.488711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:09.490044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Returning 404 to user: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:14:09.490044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-40f3b5c0-1398-44e0-8f98-317d9b76d106 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 404 len: 111 microversion: 2.1 time: 0.033060 May 26 15:14:09.490044 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 357/711] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:09 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:14:09.496090 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9cc57a58-4512-49b9-9ea9-c27fe30ed94d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '.version_select at 0x7ff96591e160>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:09.513237 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9cc57a58-4512-49b9-9ea9-c27fe30ed94d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521377724" status: 202 len: 0 microversion: 2.1 time: 0.021577 May 26 15:14:09.513827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 355/712] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 15:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521377724 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:14:10.052420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-472603cc-9b29-46e3-bf37-fd15430dc59f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:10.053239 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-472603cc-9b29-46e3-bf37-fd15430dc59f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:10.061888 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-472603cc-9b29-46e3-bf37-fd15430dc59f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:10.062357 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-472603cc-9b29-46e3-bf37-fd15430dc59f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:10.063148 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-472603cc-9b29-46e3-bf37-fd15430dc59f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:10.063592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-472603cc-9b29-46e3-bf37-fd15430dc59f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:10.068117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:10.187236 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-86894d7a-d65d-4ad6-b22b-4503ac4677dd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'create', calling method: .version_select at 0x7ff96569f1f0>, body: {"keypair": {"name": "tempest-keypair-1911996091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2EPpfcDzPpP43UGjWhmpsGIw5nRUowxSjkWbwnb9vjzRzjOaesV+gZ3wUxoitfSndTHs7qzRw30SPvo8cusZOv60AuuHBMvqrMUJpwf6q+PgTXLnqjIXM7N8DQ0tAkRg=="}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:10.203706 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-86894d7a-d65d-4ad6-b22b-4503ac4677dd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Getting quotas for project 0910873988084bc0becc79bb99febc96. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:14:10.208848 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-86894d7a-d65d-4ad6-b22b-4503ac4677dd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Getting quotas for user e95b6425286f4235b9d1802acddac4b8 and project 0910873988084bc0becc79bb99febc96. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:14:10.225135 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-472603cc-9b29-46e3-bf37-fd15430dc59f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:10.230498 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-86894d7a-d65d-4ad6-b22b-4503ac4677dd tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047768 May 26 15:14:10.231093 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 356/713] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:14:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:10.234548 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-472603cc-9b29-46e3-bf37-fd15430dc59f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1736 microversion: 2.1 time: 0.185976 May 26 15:14:10.235099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 358/714] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:10 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:11.253351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-01c3b8ec-2f42-47dd-89ab-e7be6b7adee8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:11.254027 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-01c3b8ec-2f42-47dd-89ab-e7be6b7adee8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:11.270655 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-01c3b8ec-2f42-47dd-89ab-e7be6b7adee8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.271105 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-01c3b8ec-2f42-47dd-89ab-e7be6b7adee8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.271884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-01c3b8ec-2f42-47dd-89ab-e7be6b7adee8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.273032 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-01c3b8ec-2f42-47dd-89ab-e7be6b7adee8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.416294 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-01c3b8ec-2f42-47dd-89ab-e7be6b7adee8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:11.426049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-01c3b8ec-2f42-47dd-89ab-e7be6b7adee8 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1716 microversion: 2.1 time: 0.177463 May 26 15:14:11.426828 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 357/715] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:11 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1716 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:11.531737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:11.532259 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:11.532624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1382731328", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b416354-97a2-42f7-a460-05ec32c4591a"}], "security_groups": [{"name": "tempest-securitygroup--1948397657"}], "key_name": "tempest-keypair-1911996091", "user_data": "}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:11.539629 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.540090 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.540876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.541389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.631293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] HTTP exception thrown: Cannot 'detach_volume' instance 4682a8fb-1ed3-492f-963e-7befa1cf839d while it is in vm_state rescued May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Request method failure captured: May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments/4a1633ec-6002-4edb-b4c3-f1601769f915 HTTP/1.1 May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5hRvwCh_0EjDjPJrKGPN-nNnnn3ra8nC-wiV8Z3ZLol3S-_v1z_BoI1WppEzWWOsw2KXu-v_YyNZ8AZKmicfOwsWNz89ANHmuHTiYJbSDuKqzhbIZKw2QZmRDOpCH9qB6dPcgVEuqPBsWBqUu-lMOyym4jaYon5YIfCwIEe5Ro_pMw May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:14:11.632808 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_45e3fe61cc704411ac645e5935b9d258", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/45e3fe61cc704411ac645e5935b9d258"}]}] May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 27172e53a12a437c9d57a75a95727d71 May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:14:11.634373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Cannot 'detach_volume' instance 4682a8fb-1ed3-492f-963e-7befa1cf839d while it is in vm_state rescued May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'server_id': '4682a8fb-1ed3-492f-963e-7befa1cf839d', 'id': '4a1633ec-6002-4edb-b4c3-f1601769f915'} May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4682a8fb-1ed3-492f-963e-7befa1cf839d in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:14:11.635117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4682a8fb-1ed3-492f-963e-7befa1cf839d while it is in vm_state rescued May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4682a8fb-1ed3-492f-963e-7befa1cf839d while it is in vm_state rescued May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:14:11.636477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Returning 409 to user: Cannot 'detach_volume' instance 4682a8fb-1ed3-492f-963e-7befa1cf839d while it is in vm_state rescued {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:14:11.637733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bcfe3ac6-418b-4993-b0d7-2838e76f1a51 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments/4a1633ec-6002-4edb-b4c3-f1601769f915" status: 409 len: 152 microversion: 2.1 time: 0.107123 May 26 15:14:11.637733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 359/716] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:14:11 2022] DELETE /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments/4a1633ec-6002-4edb-b4c3-f1601769f915 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 15:14:11.643278 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a156b67a-25bf-4cbc-97ff-791b1391832f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:11.644031 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a156b67a-25bf-4cbc-97ff-791b1391832f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:11.645406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.network.neutron [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] validate_networks() for [('8b416354-97a2-42f7-a460-05ec32c4591a', None, None, None, None, None)] {{(pid=117724) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:14:11.650251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a156b67a-25bf-4cbc-97ff-791b1391832f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.650728 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a156b67a-25bf-4cbc-97ff-791b1391832f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.651460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a156b67a-25bf-4cbc-97ff-791b1391832f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.651927 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a156b67a-25bf-4cbc-97ff-791b1391832f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.720392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a156b67a-25bf-4cbc-97ff-791b1391832f tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "POST /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/action" status: 202 len: 0 microversion: 2.1 time: 0.080662 May 26 15:14:11.724200 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 360/717] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:14:11 2022] POST /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:14:11.729612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-45948b3a-798a-4071-b922-5ac49a1716d6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:11.730448 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-45948b3a-798a-4071-b922-5ac49a1716d6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:11.737620 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45948b3a-798a-4071-b922-5ac49a1716d6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.738124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45948b3a-798a-4071-b922-5ac49a1716d6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.738925 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45948b3a-798a-4071-b922-5ac49a1716d6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:11.739375 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45948b3a-798a-4071-b922-5ac49a1716d6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:11.943901 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45948b3a-798a-4071-b922-5ac49a1716d6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:11.952893 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-45948b3a-798a-4071-b922-5ac49a1716d6 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1724 microversion: 2.1 time: 0.227367 May 26 15:14:11.953917 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 361/718] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:11 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:12.124049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Flavor limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:14:12.124544 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Image limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:14:12.125051 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Flavor pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:14:12.125508 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Image pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:14:12.125928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:14:12.135110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:12.135566 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:12.136357 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:12.136789 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:12.155236 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Getting quotas for project 0910873988084bc0becc79bb99febc96. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:14:12.159230 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Getting quotas for user e95b6425286f4235b9d1802acddac4b8 and project 0910873988084bc0becc79bb99febc96. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:14:12.171823 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Going to run 1 instances... {{(pid=117724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:14:12.174472 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:14:12.223125 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a84ee785-2b75-4d43-8a43-54f4497e28bb tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.695159 May 26 15:14:12.223948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 358/719] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:14:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:14:12.233828 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-68f8f471-4931-48bb-8038-162bc0ad3ec5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:12.234458 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-68f8f471-4931-48bb-8038-162bc0ad3ec5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:12.290691 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-68f8f471-4931-48bb-8038-162bc0ad3ec5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:12.297909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-68f8f471-4931-48bb-8038-162bc0ad3ec5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1238 microversion: 2.1 time: 0.067631 May 26 15:14:12.298636 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 362/720] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:12 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:12.972156 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b97bd2d2-f6da-4017-a20a-34bda7aa2e1c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:12.973046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b97bd2d2-f6da-4017-a20a-34bda7aa2e1c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:12.981117 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b97bd2d2-f6da-4017-a20a-34bda7aa2e1c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:12.981594 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b97bd2d2-f6da-4017-a20a-34bda7aa2e1c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:12.982353 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b97bd2d2-f6da-4017-a20a-34bda7aa2e1c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:12.983420 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b97bd2d2-f6da-4017-a20a-34bda7aa2e1c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.118343 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b97bd2d2-f6da-4017-a20a-34bda7aa2e1c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:13.126729 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b97bd2d2-f6da-4017-a20a-34bda7aa2e1c tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1724 microversion: 2.1 time: 0.160144 May 26 15:14:13.127301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 359/721] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:12 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:13.315383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-60692f83-2ccb-40c0-beb0-b196c6059a28 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:13.315993 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-60692f83-2ccb-40c0-beb0-b196c6059a28 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:13.322904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60692f83-2ccb-40c0-beb0-b196c6059a28 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:13.323357 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60692f83-2ccb-40c0-beb0-b196c6059a28 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.324094 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60692f83-2ccb-40c0-beb0-b196c6059a28 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:13.324527 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-60692f83-2ccb-40c0-beb0-b196c6059a28 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:13.386536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-60692f83-2ccb-40c0-beb0-b196c6059a28 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:13.394409 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-60692f83-2ccb-40c0-beb0-b196c6059a28 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1242 microversion: 2.1 time: 0.082864 May 26 15:14:13.394963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 363/722] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:13 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:14.145259 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6bb7184d-492b-4fdb-abcc-92a628907413 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:14.145897 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6bb7184d-492b-4fdb-abcc-92a628907413 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:14.151896 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6bb7184d-492b-4fdb-abcc-92a628907413 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.152340 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6bb7184d-492b-4fdb-abcc-92a628907413 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:14.153095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6bb7184d-492b-4fdb-abcc-92a628907413 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.153559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6bb7184d-492b-4fdb-abcc-92a628907413 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:14.286816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6bb7184d-492b-4fdb-abcc-92a628907413 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:14.295748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6bb7184d-492b-4fdb-abcc-92a628907413 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1724 microversion: 2.1 time: 0.154882 May 26 15:14:14.297497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 360/723] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:14 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:14.527689 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1837cbe9-ef33-42d1-8c67-aac04d931b2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:14.528309 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1837cbe9-ef33-42d1-8c67-aac04d931b2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:14.538505 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1837cbe9-ef33-42d1-8c67-aac04d931b2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.538959 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1837cbe9-ef33-42d1-8c67-aac04d931b2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:14.539726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1837cbe9-ef33-42d1-8c67-aac04d931b2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:14.540165 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1837cbe9-ef33-42d1-8c67-aac04d931b2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:14.605898 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1837cbe9-ef33-42d1-8c67-aac04d931b2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:14.615004 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1837cbe9-ef33-42d1-8c67-aac04d931b2b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1290 microversion: 2.1 time: 0.206780 May 26 15:14:14.615577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 364/724] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:14 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1290 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:15.314730 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9d20b6e8-d02c-410c-ac44-98f04747cd3a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:15.316196 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9d20b6e8-d02c-410c-ac44-98f04747cd3a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:15.323161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9d20b6e8-d02c-410c-ac44-98f04747cd3a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:15.323610 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9d20b6e8-d02c-410c-ac44-98f04747cd3a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:15.324405 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9d20b6e8-d02c-410c-ac44-98f04747cd3a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:15.324978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9d20b6e8-d02c-410c-ac44-98f04747cd3a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:15.486326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9d20b6e8-d02c-410c-ac44-98f04747cd3a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:15.495814 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9d20b6e8-d02c-410c-ac44-98f04747cd3a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1730 microversion: 2.1 time: 0.184975 May 26 15:14:15.496404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 361/725] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:15 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:15.512405 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-89fb5611-d448-4601-8990-30fd4613ea9e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:15.512897 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-89fb5611-d448-4601-8990-30fd4613ea9e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:15.519864 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89fb5611-d448-4601-8990-30fd4613ea9e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:15.520311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89fb5611-d448-4601-8990-30fd4613ea9e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:15.521062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89fb5611-d448-4601-8990-30fd4613ea9e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:15.521515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89fb5611-d448-4601-8990-30fd4613ea9e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:15.598900 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-89fb5611-d448-4601-8990-30fd4613ea9e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090596 May 26 15:14:15.599502 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 365/726] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 15:14:15 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:15.632302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-40677122-8b31-40ea-98cb-a86903bd8f56 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:15.632962 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-40677122-8b31-40ea-98cb-a86903bd8f56 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:15.641142 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-40677122-8b31-40ea-98cb-a86903bd8f56 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:15.641628 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-40677122-8b31-40ea-98cb-a86903bd8f56 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:15.642401 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-40677122-8b31-40ea-98cb-a86903bd8f56 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:15.642846 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-40677122-8b31-40ea-98cb-a86903bd8f56 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:15.738956 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-40677122-8b31-40ea-98cb-a86903bd8f56 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:15.747941 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-40677122-8b31-40ea-98cb-a86903bd8f56 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1296 microversion: 2.1 time: 0.119547 May 26 15:14:15.748649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 362/727] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:15 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:16.600112 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-76a0e67c-8e03-42ff-903e-326b4a39287b req-4d6290fd-d342-4d61-854e-130fc045feab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4682a8fb-1ed3-492f-963e-7befa1cf839d", "tag": "af1b1d4b-d86d-4d01-b349-f19b08f5f132"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:16.617907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-76a0e67c-8e03-42ff-903e-326b4a39287b req-4d6290fd-d342-4d61-854e-130fc045feab service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:16.618712 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-76a0e67c-8e03-42ff-903e-326b4a39287b req-4d6290fd-d342-4d61-854e-130fc045feab service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:16.643014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-76a0e67c-8e03-42ff-903e-326b4a39287b req-4d6290fd-d342-4d61-854e-130fc045feab service nova] Creating event network-changed:af1b1d4b-d86d-4d01-b349-f19b08f5f132 for instance 4682a8fb-1ed3-492f-963e-7befa1cf839d on hv-cinder-78836 May 26 15:14:16.648688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-76a0e67c-8e03-42ff-903e-326b4a39287b req-4d6290fd-d342-4d61-854e-130fc045feab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053279 May 26 15:14:16.650037 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 366/728] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:16.766355 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ca78546a-1c87-4e4e-8620-b81ab6625712 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:16.767665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ca78546a-1c87-4e4e-8620-b81ab6625712 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:16.771737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:16.776094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca78546a-1c87-4e4e-8620-b81ab6625712 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:16.776936 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca78546a-1c87-4e4e-8620-b81ab6625712 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:16.778736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca78546a-1c87-4e4e-8620-b81ab6625712 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:16.779507 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca78546a-1c87-4e4e-8620-b81ab6625712 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:17.032562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ca78546a-1c87-4e4e-8620-b81ab6625712 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:17.043963 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ca78546a-1c87-4e4e-8620-b81ab6625712 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1364 microversion: 2.1 time: 0.281633 May 26 15:14:17.055121 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 363/729] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:16 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:17.246555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-deee52ad-dc8a-4881-a365-96fe392111d1 req-921b13b6-bc1f-44d1-b7a9-7c118423d26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b5c917-96e8-4255-8694-9f5e2c576bf8", "tag": "f871e666-9660-4b15-9eb5-a7c607fa8094"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:17.256347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-deee52ad-dc8a-4881-a365-96fe392111d1 req-921b13b6-bc1f-44d1-b7a9-7c118423d26b service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:17.257069 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-deee52ad-dc8a-4881-a365-96fe392111d1 req-921b13b6-bc1f-44d1-b7a9-7c118423d26b service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:17.270924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-deee52ad-dc8a-4881-a365-96fe392111d1 req-921b13b6-bc1f-44d1-b7a9-7c118423d26b service nova] Creating event network-changed:f871e666-9660-4b15-9eb5-a7c607fa8094 for instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 on hv-cinder-78836 May 26 15:14:17.278381 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-deee52ad-dc8a-4881-a365-96fe392111d1 req-921b13b6-bc1f-44d1-b7a9-7c118423d26b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036562 May 26 15:14:17.279000 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 367/730] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:18.061987 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5457b4e4-222b-4df3-ab31-588433ecee53 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:18.062596 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5457b4e4-222b-4df3-ab31-588433ecee53 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:18.069520 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5457b4e4-222b-4df3-ab31-588433ecee53 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:18.069975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5457b4e4-222b-4df3-ab31-588433ecee53 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:18.070740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5457b4e4-222b-4df3-ab31-588433ecee53 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:18.071172 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5457b4e4-222b-4df3-ab31-588433ecee53 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:18.214673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5457b4e4-222b-4df3-ab31-588433ecee53 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:18.223763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5457b4e4-222b-4df3-ab31-588433ecee53 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1364 microversion: 2.1 time: 0.166138 May 26 15:14:18.224378 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 364/731] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:18 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:18.722005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-08241d56-974d-4911-9071-d1a32ebc1dea req-cbe64f66-003f-4bc4-b943-ab9b661ae24e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4682a8fb-1ed3-492f-963e-7befa1cf839d", "tag": "af1b1d4b-d86d-4d01-b349-f19b08f5f132"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:18.730361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-08241d56-974d-4911-9071-d1a32ebc1dea req-cbe64f66-003f-4bc4-b943-ab9b661ae24e service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:18.730805 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-08241d56-974d-4911-9071-d1a32ebc1dea req-cbe64f66-003f-4bc4-b943-ab9b661ae24e service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:18.744501 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-08241d56-974d-4911-9071-d1a32ebc1dea req-cbe64f66-003f-4bc4-b943-ab9b661ae24e service nova] Creating event network-changed:af1b1d4b-d86d-4d01-b349-f19b08f5f132 for instance 4682a8fb-1ed3-492f-963e-7befa1cf839d on hv-cinder-78836 May 26 15:14:18.750183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-08241d56-974d-4911-9071-d1a32ebc1dea req-cbe64f66-003f-4bc4-b943-ab9b661ae24e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090070 May 26 15:14:18.750786 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 368/732] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:19.241967 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e7b9f814-dd91-4a0e-917a-2d7ad5c78ec8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:19.242748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e7b9f814-dd91-4a0e-917a-2d7ad5c78ec8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:19.249909 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e7b9f814-dd91-4a0e-917a-2d7ad5c78ec8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:19.250505 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e7b9f814-dd91-4a0e-917a-2d7ad5c78ec8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:19.251374 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e7b9f814-dd91-4a0e-917a-2d7ad5c78ec8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:19.252054 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e7b9f814-dd91-4a0e-917a-2d7ad5c78ec8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:19.256601 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=100 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:19.464763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e7b9f814-dd91-4a0e-917a-2d7ad5c78ec8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:19.474010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e7b9f814-dd91-4a0e-917a-2d7ad5c78ec8 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1364 microversion: 2.1 time: 0.235675 May 26 15:14:19.474763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 365/733] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:19 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:20.492857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d5494d05-0d66-4b4d-9ec0-9c53f44e1bf3 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:20.493611 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d5494d05-0d66-4b4d-9ec0-9c53f44e1bf3 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:20.501312 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5494d05-0d66-4b4d-9ec0-9c53f44e1bf3 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:20.501785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5494d05-0d66-4b4d-9ec0-9c53f44e1bf3 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:20.502549 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5494d05-0d66-4b4d-9ec0-9c53f44e1bf3 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:20.502981 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d5494d05-0d66-4b4d-9ec0-9c53f44e1bf3 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:20.638777 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d5494d05-0d66-4b4d-9ec0-9c53f44e1bf3 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:20.646917 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d5494d05-0d66-4b4d-9ec0-9c53f44e1bf3 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1364 microversion: 2.1 time: 0.158619 May 26 15:14:20.647484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 369/734] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:20 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:21.131054 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d0015a81-ef6c-45ec-89a9-96a304c33487 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:21.131717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d0015a81-ef6c-45ec-89a9-96a304c33487 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:21.137962 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d0015a81-ef6c-45ec-89a9-96a304c33487 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:21.138415 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d0015a81-ef6c-45ec-89a9-96a304c33487 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:21.139179 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d0015a81-ef6c-45ec-89a9-96a304c33487 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:21.140133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d0015a81-ef6c-45ec-89a9-96a304c33487 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:21.163870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d0015a81-ef6c-45ec-89a9-96a304c33487 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/ips" status: 200 len: 151 microversion: 2.1 time: 0.145586 May 26 15:14:21.164439 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 366/735] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:14:21 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/ips => generated 151 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:21.468366 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-30cf8040-dc07-4eaa-a27a-fe04fa239417 req-dabdadc7-83b5-4314-a367-524bc1204fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b5c917-96e8-4255-8694-9f5e2c576bf8", "name": "network-vif-plugged", "status": "completed", "tag": "f871e666-9660-4b15-9eb5-a7c607fa8094"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:21.479502 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-30cf8040-dc07-4eaa-a27a-fe04fa239417 req-dabdadc7-83b5-4314-a367-524bc1204fa0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:21.480026 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-30cf8040-dc07-4eaa-a27a-fe04fa239417 req-dabdadc7-83b5-4314-a367-524bc1204fa0 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:21.492887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-30cf8040-dc07-4eaa-a27a-fe04fa239417 req-dabdadc7-83b5-4314-a367-524bc1204fa0 service nova] Creating event network-vif-plugged:f871e666-9660-4b15-9eb5-a7c607fa8094 for instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 on hv-cinder-78836 May 26 15:14:21.502609 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-30cf8040-dc07-4eaa-a27a-fe04fa239417 req-dabdadc7-83b5-4314-a367-524bc1204fa0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039125 May 26 15:14:21.503290 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 370/736] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:21.664288 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7a2dab6f-3a69-4761-904d-f9822ada5055 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:21.664918 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7a2dab6f-3a69-4761-904d-f9822ada5055 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:21.672132 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7a2dab6f-3a69-4761-904d-f9822ada5055 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:21.672802 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7a2dab6f-3a69-4761-904d-f9822ada5055 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:21.673632 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7a2dab6f-3a69-4761-904d-f9822ada5055 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:21.674121 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7a2dab6f-3a69-4761-904d-f9822ada5055 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:21.861794 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7a2dab6f-3a69-4761-904d-f9822ada5055 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:21.869869 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7a2dab6f-3a69-4761-904d-f9822ada5055 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1364 microversion: 2.1 time: 0.209522 May 26 15:14:21.870452 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 367/737] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:21 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:22.095260 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-dd0e8eb3-3003-4c45-b6ec-3605580b3a69 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:22.095918 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-dd0e8eb3-3003-4c45-b6ec-3605580b3a69 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:22.098251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:22.103402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dd0e8eb3-3003-4c45-b6ec-3605580b3a69 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:22.103895 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dd0e8eb3-3003-4c45-b6ec-3605580b3a69 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:22.104823 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dd0e8eb3-3003-4c45-b6ec-3605580b3a69 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:22.105381 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-dd0e8eb3-3003-4c45-b6ec-3605580b3a69 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:22.133141 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-dd0e8eb3-3003-4c45-b6ec-3605580b3a69 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/ips" status: 200 len: 152 microversion: 2.20 time: 0.145930 May 26 15:14:22.133754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 371/738] 10.222.0.46 () {60 vars in 1288 bytes} [Thu May 26 15:14:21 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/ips => generated 152 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:14:22.544280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a0af1b28-c33e-49f1-bba0-61d62fcf11c4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09b6c9af-d531-47eb-b88a-b1a145e581b8"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:22.546033 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a0af1b28-c33e-49f1-bba0-61d62fcf11c4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:22.548343 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:22.548955 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=10 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:22.556697 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a0af1b28-c33e-49f1-bba0-61d62fcf11c4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:22.557233 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a0af1b28-c33e-49f1-bba0-61d62fcf11c4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:22.558226 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a0af1b28-c33e-49f1-bba0-61d62fcf11c4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:22.558695 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a0af1b28-c33e-49f1-bba0-61d62fcf11c4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:22.857840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a0af1b28-c33e-49f1-bba0-61d62fcf11c4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317669 May 26 15:14:22.859133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 368/739] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:14:22 2022] POST /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:22.884848 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:22.889530 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8543d6b1-1f45-4c89-a7b0-728d043dd468 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:22.890143 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8543d6b1-1f45-4c89-a7b0-728d043dd468 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:22.896970 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8543d6b1-1f45-4c89-a7b0-728d043dd468 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:22.897417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8543d6b1-1f45-4c89-a7b0-728d043dd468 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:22.898205 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8543d6b1-1f45-4c89-a7b0-728d043dd468 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:22.898643 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8543d6b1-1f45-4c89-a7b0-728d043dd468 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:23.053269 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8543d6b1-1f45-4c89-a7b0-728d043dd468 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:23.061485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8543d6b1-1f45-4c89-a7b0-728d043dd468 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1364 microversion: 2.1 time: 0.177353 May 26 15:14:23.062042 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 372/740] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:22 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:23.995129 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bd299ac5-c65d-4016-9708-505ea1ae0811 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:23.995762 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bd299ac5-c65d-4016-9708-505ea1ae0811 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:24.003362 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bd299ac5-c65d-4016-9708-505ea1ae0811 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.003821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bd299ac5-c65d-4016-9708-505ea1ae0811 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.004595 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bd299ac5-c65d-4016-9708-505ea1ae0811 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.005038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bd299ac5-c65d-4016-9708-505ea1ae0811 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.027406 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-bd299ac5-c65d-4016-9708-505ea1ae0811 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lazy-loading 'flavor' on Instance uuid 399eff3a-ae28-4b3d-a00c-36e004e509da {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:14:24.079018 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c7ed649f-d72d-4eef-801a-b9cd7d42b03d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:24.079758 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c7ed649f-d72d-4eef-801a-b9cd7d42b03d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:24.087525 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7ed649f-d72d-4eef-801a-b9cd7d42b03d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.087525 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7ed649f-d72d-4eef-801a-b9cd7d42b03d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.088430 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7ed649f-d72d-4eef-801a-b9cd7d42b03d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.088938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c7ed649f-d72d-4eef-801a-b9cd7d42b03d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.229077 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c7ed649f-d72d-4eef-801a-b9cd7d42b03d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:24.237285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c7ed649f-d72d-4eef-801a-b9cd7d42b03d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1549 microversion: 2.1 time: 0.162373 May 26 15:14:24.237923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 373/741] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:24 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:24.254169 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9ddd4e7a-d017-4806-af0e-a02794745085 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:24.254634 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9ddd4e7a-d017-4806-af0e-a02794745085 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:24.260649 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ddd4e7a-d017-4806-af0e-a02794745085 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.261091 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ddd4e7a-d017-4806-af0e-a02794745085 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.261876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ddd4e7a-d017-4806-af0e-a02794745085 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.262332 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ddd4e7a-d017-4806-af0e-a02794745085 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.307245 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bd299ac5-c65d-4016-9708-505ea1ae0811 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/action" status: 202 len: 0 microversion: 2.20 time: 0.316919 May 26 15:14:24.307865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 369/742] 10.222.0.46 () {62 vars in 1318 bytes} [Thu May 26 15:14:23 2022] POST /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:14:24.317668 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:24.318171 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:24.325568 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.326176 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.328088 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:24.328554 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:24.353823 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9ddd4e7a-d017-4806-af0e-a02794745085 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103503 May 26 15:14:24.354415 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 374/743] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 15:14:24 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:24.465194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:24.474100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:24.475609 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:24.476774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8f896a76-61ab-4e26-a777-76fda5ffebfc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.163649 May 26 15:14:24.477517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 370/744] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:24 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:25.334904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-270ac0db-aa41-4e2a-9776-b84520c680e6 req-ca913e54-0c62-4870-adaa-0cd16f0965f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b5c917-96e8-4255-8694-9f5e2c576bf8", "tag": "f871e666-9660-4b15-9eb5-a7c607fa8094"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:25.343714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-270ac0db-aa41-4e2a-9776-b84520c680e6 req-ca913e54-0c62-4870-adaa-0cd16f0965f3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:25.344159 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-270ac0db-aa41-4e2a-9776-b84520c680e6 req-ca913e54-0c62-4870-adaa-0cd16f0965f3 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:25.355684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-270ac0db-aa41-4e2a-9776-b84520c680e6 req-ca913e54-0c62-4870-adaa-0cd16f0965f3 service nova] Creating event network-changed:f871e666-9660-4b15-9eb5-a7c607fa8094 for instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 on hv-cinder-78836 May 26 15:14:25.362644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-270ac0db-aa41-4e2a-9776-b84520c680e6 req-ca913e54-0c62-4870-adaa-0cd16f0965f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031945 May 26 15:14:25.363455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 375/745] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:25.496656 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:25.497277 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:25.505739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:25.506289 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:25.507511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:25.508181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:25.881271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:25.890214 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:25.892001 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:25.894097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ee4ddc86-e22b-43ef-871f-2f01ac914abb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.401921 May 26 15:14:25.905427 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 371/746] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:25 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:26.914319 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:26.915139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:26.921371 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:26.921861 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:26.922638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:26.923078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:27.083574 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:27.093003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:27.094584 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:27.096420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c81a52f6-d4e2-4366-8668-a15c19ec9027 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.187231 May 26 15:14:27.097396 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 376/747] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:26 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:28.116481 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:28.117216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:28.124281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:28.124724 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:28.125516 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:28.125950 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:28.282422 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:28.290701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:28.292223 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:28.293392 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4b1ac915-a6b8-4dff-92de-963909ec4606 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.181000 May 26 15:14:28.293973 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 372/748] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:28 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:29.318420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:29.319062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:29.325846 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:29.326327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:29.327144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:29.327584 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:29.470336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:29.480649 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:29.482216 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:29.483424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a4b99e4e-a8f7-4b95-9403-916b87d9232e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.169285 May 26 15:14:29.483984 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 377/749] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:29 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:30.456603 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09b6c9af-d531-47eb-b88a-b1a145e581b8"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:30.458096 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:30.465203 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.465691 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.466530 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.467032 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.507490 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:30.508509 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:30.527011 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.527771 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.529043 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.529857 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.575177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Invalid volume: volume 09b6c9af-d531-47eb-b88a-b1a145e581b8 is already attached to instances: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: POST /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments HTTP/1.1 May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 74 May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:14:30.578038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {"volumeAttachment": {"volumeId": "09b6c9af-d531-47eb-b88a-b1a145e581b8"}} May 26 15:14:30.580784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Invalid volume: volume 09b6c9af-d531-47eb-b88a-b1a145e581b8 is already attached to instances: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'server_id': '1fbe7683-005d-4728-8dcd-743fb3fc8a2b', 'body': {'volumeAttachment': {'volumeId': '09b6c9af-d531-47eb-b88a-b1a145e581b8'}}} May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 09b6c9af-d531-47eb-b88a-b1a145e581b8 is already attached to instances: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:30.582254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 09b6c9af-d531-47eb-b88a-b1a145e581b8 is already attached to instances: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:30.587281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:30.591133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:30.591133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:14:30.591133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:14:30.591133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 09b6c9af-d531-47eb-b88a-b1a145e581b8 is already attached to instances: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b May 26 15:14:30.591133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:30.591133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 400 to user: Invalid volume: volume 09b6c9af-d531-47eb-b88a-b1a145e581b8 is already attached to instances: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:14:30.591133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0a4fcc27-8353-42cd-a215-d3cd3aa214d9 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127563 May 26 15:14:30.591133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 373/750] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:14:30 2022] POST /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:14:30.669065 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-42b65351-8df5-4080-afdc-c2e8e5de9a03 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:30.669600 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-42b65351-8df5-4080-afdc-c2e8e5de9a03 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:30.676424 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-42b65351-8df5-4080-afdc-c2e8e5de9a03 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.676878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-42b65351-8df5-4080-afdc-c2e8e5de9a03 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.677888 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-42b65351-8df5-4080-afdc-c2e8e5de9a03 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.678324 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-42b65351-8df5-4080-afdc-c2e8e5de9a03 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.727533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:30.739604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:30.741945 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:30.744310 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-65949906-518d-4c67-b582-ea014d0768c4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.243463 May 26 15:14:30.745316 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 378/751] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:30 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:30.790560 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-42b65351-8df5-4080-afdc-c2e8e5de9a03 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lazy-loading 'services' on Instance uuid 1fbe7683-005d-4728-8dcd-743fb3fc8a2b {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:14:30.898267 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-42b65351-8df5-4080-afdc-c2e8e5de9a03 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments/09b6c9af-d531-47eb-b88a-b1a145e581b8" status: 202 len: 0 microversion: 2.1 time: 0.232872 May 26 15:14:30.898901 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 374/752] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:14:30 2022] DELETE /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments/09b6c9af-d531-47eb-b88a-b1a145e581b8 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:14:30.911449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2f6bdc35-1e95-4c78-8cf2-56b3394f3380 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:30.913278 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2f6bdc35-1e95-4c78-8cf2-56b3394f3380 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:30.923208 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f6bdc35-1e95-4c78-8cf2-56b3394f3380 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.923742 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f6bdc35-1e95-4c78-8cf2-56b3394f3380 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.925638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f6bdc35-1e95-4c78-8cf2-56b3394f3380 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:30.925638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2f6bdc35-1e95-4c78-8cf2-56b3394f3380 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:30.932053 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:30.963680 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2f6bdc35-1e95-4c78-8cf2-56b3394f3380 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060014 May 26 15:14:30.964433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 379/753] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:14:30 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:31.771773 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:31.772998 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:31.784521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:31.785324 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:31.786743 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:31.787529 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:31.980282 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1493eb0a-6acb-4a85-a639-28e5778a8879 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:31.981769 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1493eb0a-6acb-4a85-a639-28e5778a8879 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:31.992045 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1493eb0a-6acb-4a85-a639-28e5778a8879 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:31.993064 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1493eb0a-6acb-4a85-a639-28e5778a8879 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:31.994617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1493eb0a-6acb-4a85-a639-28e5778a8879 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:31.995330 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1493eb0a-6acb-4a85-a639-28e5778a8879 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:32.003729 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:32.017248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:32.020227 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:32.024247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7882cd4b-d1c1-475a-8935-724098d293b9 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.258780 May 26 15:14:32.024247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 375/754] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:31 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:32.045989 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1493eb0a-6acb-4a85-a639-28e5778a8879 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071657 May 26 15:14:32.046684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 380/755] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:14:31 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:14:32.132312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-75f019a5-cf93-4d39-8e5a-399207d7a106 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:32.132821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-75f019a5-cf93-4d39-8e5a-399207d7a106 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:32.143208 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75f019a5-cf93-4d39-8e5a-399207d7a106 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:32.143663 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75f019a5-cf93-4d39-8e5a-399207d7a106 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:32.144451 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75f019a5-cf93-4d39-8e5a-399207d7a106 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:32.144888 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75f019a5-cf93-4d39-8e5a-399207d7a106 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:32.176345 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-75f019a5-cf93-4d39-8e5a-399207d7a106 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:14:32.233588 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:32.275864 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-75f019a5-cf93-4d39-8e5a-399207d7a106 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 204 len: 0 microversion: 2.1 time: 0.153272 May 26 15:14:32.276571 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 376/756] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:14:32 2022] DELETE /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:14:32.285417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-47d891e7-2b42-4912-8de4-63016d64bdf1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:32.286211 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-47d891e7-2b42-4912-8de4-63016d64bdf1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:32.292554 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47d891e7-2b42-4912-8de4-63016d64bdf1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:32.293003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47d891e7-2b42-4912-8de4-63016d64bdf1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:32.293832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47d891e7-2b42-4912-8de4-63016d64bdf1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:32.294275 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-47d891e7-2b42-4912-8de4-63016d64bdf1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:32.455590 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-47d891e7-2b42-4912-8de4-63016d64bdf1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:32.464649 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-47d891e7-2b42-4912-8de4-63016d64bdf1 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1682 microversion: 2.1 time: 0.183114 May 26 15:14:32.465223 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 381/757] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:32 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:33.052181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:33.052889 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:33.059943 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:33.060488 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:33.061372 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:33.061903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:33.240770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:33.250149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:33.251759 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:33.253103 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-557ac49f-91fc-4c2a-901f-0dc0c7c1bd45 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.205301 May 26 15:14:33.254102 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 377/758] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:33 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:33.484560 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-abfe4900-1f51-4dcb-b605-0ea93252ae56 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:33.485414 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-abfe4900-1f51-4dcb-b605-0ea93252ae56 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:33.492616 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-abfe4900-1f51-4dcb-b605-0ea93252ae56 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:33.493167 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-abfe4900-1f51-4dcb-b605-0ea93252ae56 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:33.494160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-abfe4900-1f51-4dcb-b605-0ea93252ae56 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:33.494658 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-abfe4900-1f51-4dcb-b605-0ea93252ae56 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:33.664678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-abfe4900-1f51-4dcb-b605-0ea93252ae56 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:33.675057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-abfe4900-1f51-4dcb-b605-0ea93252ae56 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1682 microversion: 2.1 time: 0.195226 May 26 15:14:33.675762 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 382/759] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:33 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:34.273554 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:34.274289 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:34.283387 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.284162 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.285803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.286662 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.540941 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:34.553954 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:34.556459 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:34.558300 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8518785a-5a4d-4dbc-8b05-dbb19ad51c4b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.289182 May 26 15:14:34.559104 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 378/760] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:34 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:34.698021 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-45994c08-e1ec-4756-af8e-be26a011526e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:34.699153 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-45994c08-e1ec-4756-af8e-be26a011526e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:34.714642 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45994c08-e1ec-4756-af8e-be26a011526e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.715458 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45994c08-e1ec-4756-af8e-be26a011526e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:34.717300 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45994c08-e1ec-4756-af8e-be26a011526e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:34.718711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-45994c08-e1ec-4756-af8e-be26a011526e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:35.007319 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-45994c08-e1ec-4756-af8e-be26a011526e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:35.015542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-45994c08-e1ec-4756-af8e-be26a011526e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1682 microversion: 2.1 time: 0.325299 May 26 15:14:35.016113 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 383/761] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:34 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1682 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:35.258859 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-aacf03b1-4518-4429-bb65-23f90e8830ba req-28e3e6a8-e190-4466-8c8a-34201f0ddde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbe7683-005d-4728-8dcd-743fb3fc8a2b", "name": "network-vif-deleted", "tag": "1cbb80ed-1bc4-49d4-9c28-74651ada43c4"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:35.276696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-aacf03b1-4518-4429-bb65-23f90e8830ba req-28e3e6a8-e190-4466-8c8a-34201f0ddde6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:35.278532 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-aacf03b1-4518-4429-bb65-23f90e8830ba req-28e3e6a8-e190-4466-8c8a-34201f0ddde6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:35.304061 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-aacf03b1-4518-4429-bb65-23f90e8830ba req-28e3e6a8-e190-4466-8c8a-34201f0ddde6 service nova] Creating event network-vif-deleted:1cbb80ed-1bc4-49d4-9c28-74651ada43c4 for instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b on hv-cinder-78836 May 26 15:14:35.313904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-aacf03b1-4518-4429-bb65-23f90e8830ba req-28e3e6a8-e190-4466-8c8a-34201f0ddde6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065201 May 26 15:14:35.315481 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 379/762] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:35.579876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:35.580560 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:35.587965 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:35.588422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:35.589201 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:35.589687 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:35.737235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:35.746150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:35.747696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:35.749399 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-24208107-ba3b-4cc5-8901-685f533e7e50 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.174350 May 26 15:14:35.750092 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 384/763] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:35 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:36.035295 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:36.036413 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:36.044072 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:36.045481 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:36.047320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:36.047855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:36.088899 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:36.090081 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:36.090081 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lazy-loading 'fault' on Instance uuid 1fbe7683-005d-4728-8dcd-743fb3fc8a2b {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:14:36.143351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:36.150712 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7b249e10-3633-437e-becc-6df4ea35224c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 200 len: 1331 microversion: 2.1 time: 0.120556 May 26 15:14:36.151286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 380/764] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:36 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:36.767931 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:36.768585 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:36.775191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:36.775646 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:36.776430 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:36.776885 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:36.916260 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:36.924494 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:36.926182 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:36.927336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4ad4a8a6-f1f0-4743-a501-277ca3b58e52 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.164190 May 26 15:14:36.927908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 385/765] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:36 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:37.168392 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:37.169006 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:37.176506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:37.176949 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:37.177878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:37.178329 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:37.193030 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b HTTP/1.1 May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:14:37.194772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:14:37.197379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '1fbe7683-005d-4728-8dcd-743fb3fc8a2b'} May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:14:37.199031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:14:37.202133 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:14:37.205034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:14:37.205034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d1532059-3dfd-413c-8a42-4fc862caedc4 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 404 len: 111 microversion: 2.1 time: 0.031789 May 26 15:14:37.205034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 381/766] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:37 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:14:37.208890 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0cfd295d-5ccb-4030-b55b-559a62f39a7d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '.version_select at 0x7ff965fd48b0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:37.227456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0cfd295d-5ccb-4030-b55b-559a62f39a7d tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725305560" status: 202 len: 0 microversion: 2.1 time: 0.023306 May 26 15:14:37.228013 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 386/767] 10.222.0.46 () {58 vars in 1217 bytes} [Thu May 26 15:14:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725305560 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:14:37.941985 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-14f7d59a-3fb0-44cd-b1d3-745f5fa18d80 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: .version_select at 0x7ff9656b00d0>, body: {"keypair": {"name": "tempest-keypair-1022567984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqddi7OdPvWmQkpu3UeYu4sPtS5+YWEU8qzJMP+V/B9+qjQsq80szlIxU3XwJO9dguuma1+Fn/hmyArLC3XnV+hT8a6V0O5FmbgQVeWxUfNwOmQy1hXd3Bp8wPl+q/+mQ=="}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:37.947403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:37.948303 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:37.956719 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:37.957223 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:37.958136 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-14f7d59a-3fb0-44cd-b1d3-745f5fa18d80 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for project 9780d0cae62c4f5088060b530571ebb3. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:14:37.958329 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:37.958725 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:37.962580 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-14f7d59a-3fb0-44cd-b1d3-745f5fa18d80 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for user 2ce5b5d5a12743bc80a4b191c24ff52f and project 9780d0cae62c4f5088060b530571ebb3. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:14:37.988875 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-14f7d59a-3fb0-44cd-b1d3-745f5fa18d80 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051010 May 26 15:14:37.999933 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 382/768] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:14:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:38.161034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:38.173516 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:38.175558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:38.176926 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5d6cccbb-308b-4bdb-9aef-71c2de1b291e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.233965 May 26 15:14:38.177657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 387/769] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:37 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:39.204853 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:39.205436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:39.213675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:39.214126 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:39.214902 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:39.215341 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:39.361008 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:39.374400 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:39.375939 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:39.377124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0b3f19dd-19a7-4c38-b67e-8f524bcd5f1e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.178007 May 26 15:14:39.377720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 383/770] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:39 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:39.404206 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1223817157", "imageRef": "a459578f-17df-48ae-8eab-f0ec289260cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf638e18-3aa1-4ba6-b2c0-e624f717acb0"}], "security_groups": [{"name": "tempest-securitygroup--850579961"}], "key_name": "tempest-keypair-1022567984", "user_data": "}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:39.512783 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] validate_networks() for [('bf638e18-3aa1-4ba6-b2c0-e624f717acb0', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:14:39.965529 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:14:39.966073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:14:39.967346 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:14:39.967824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:14:39.968291 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:14:39.977873 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:39.978310 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:39.979146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:39.979625 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:39.997561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for project 9780d0cae62c4f5088060b530571ebb3. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:14:40.001499 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Getting quotas for user 2ce5b5d5a12743bc80a4b191c24ff52f and project 9780d0cae62c4f5088060b530571ebb3. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:14:40.012604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:14:40.014938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a459578f-17df-48ae-8eab-f0ec289260cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:14:40.060904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-464c06be-d334-4eb2-8338-876b7088ed89 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.661017 May 26 15:14:40.061578 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 388/771] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:14:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:14:40.072235 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c59dad78-f753-4ae0-b944-c6b6795daeec tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:40.072856 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c59dad78-f753-4ae0-b944-c6b6795daeec tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:40.130225 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c59dad78-f753-4ae0-b944-c6b6795daeec tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:40.140484 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c59dad78-f753-4ae0-b944-c6b6795daeec tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1242 microversion: 2.1 time: 0.071814 May 26 15:14:40.141324 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 384/772] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:40 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:40.396509 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:40.397483 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:40.406263 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:40.407003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:40.407485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:40.407922 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:40.795821 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:40.803776 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:40.805312 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:40.806606 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3a3d3c25-819d-42d0-a054-6dcf516c08d1 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1743 microversion: 2.20 time: 0.414967 May 26 15:14:40.807166 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 389/773] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:40 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1743 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:41.163474 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-24fb8ae3-f1f6-4681-9807-9bd81ee22302 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:41.164202 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-24fb8ae3-f1f6-4681-9807-9bd81ee22302 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:41.171398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24fb8ae3-f1f6-4681-9807-9bd81ee22302 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:41.171848 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24fb8ae3-f1f6-4681-9807-9bd81ee22302 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:41.172610 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24fb8ae3-f1f6-4681-9807-9bd81ee22302 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:41.173042 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24fb8ae3-f1f6-4681-9807-9bd81ee22302 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:41.242021 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-24fb8ae3-f1f6-4681-9807-9bd81ee22302 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:41.252358 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-24fb8ae3-f1f6-4681-9807-9bd81ee22302 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1302 microversion: 2.1 time: 0.092682 May 26 15:14:41.252944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 385/774] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:41 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:41.826996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:41.828129 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:41.834315 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:41.834772 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:41.835576 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:41.835997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:42.115549 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:42.124768 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:42.126573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:42.127860 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fe19cf12-febf-4375-86dd-bc298e4a259a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1743 microversion: 2.20 time: 0.305694 May 26 15:14:42.128504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 390/775] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:41 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1743 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:42.285788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6a40c854-ef71-4614-be81-9e350bf5e4af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:42.286867 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6a40c854-ef71-4614-be81-9e350bf5e4af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:42.298977 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6a40c854-ef71-4614-be81-9e350bf5e4af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:42.300088 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6a40c854-ef71-4614-be81-9e350bf5e4af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:42.301648 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6a40c854-ef71-4614-be81-9e350bf5e4af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:42.302601 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6a40c854-ef71-4614-be81-9e350bf5e4af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:42.628002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6a40c854-ef71-4614-be81-9e350bf5e4af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:42.643400 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6a40c854-ef71-4614-be81-9e350bf5e4af tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1367 microversion: 2.1 time: 0.370168 May 26 15:14:42.644885 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 386/776] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:42 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:43.150681 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:43.151254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:43.164035 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:43.164504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:43.165926 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:43.166576 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:43.445564 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-485cf8f8-6b7f-4d7c-8ec5-ba56fd3d3da8 req-bd6c6cb5-10b2-46be-9adc-3c3c883acf1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7271edca-3b23-4dc4-aa5e-728df4f00cfd", "tag": "bc982787-f0cd-4e5d-9f77-626bef64840b"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:43.463535 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:43.476733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:43.480145 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:43.484090 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7938660f-15bb-4b7c-b5c6-9b829378e532 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1738 microversion: 2.20 time: 0.340914 May 26 15:14:43.497980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 391/777] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:43 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1738 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:43.500314 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-485cf8f8-6b7f-4d7c-8ec5-ba56fd3d3da8 req-bd6c6cb5-10b2-46be-9adc-3c3c883acf1c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:43.500964 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-485cf8f8-6b7f-4d7c-8ec5-ba56fd3d3da8 req-bd6c6cb5-10b2-46be-9adc-3c3c883acf1c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:43.551216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-485cf8f8-6b7f-4d7c-8ec5-ba56fd3d3da8 req-bd6c6cb5-10b2-46be-9adc-3c3c883acf1c service nova] Creating event network-changed:bc982787-f0cd-4e5d-9f77-626bef64840b for instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd on hv-cinder-78836 May 26 15:14:43.563160 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-485cf8f8-6b7f-4d7c-8ec5-ba56fd3d3da8 req-bd6c6cb5-10b2-46be-9adc-3c3c883acf1c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121691 May 26 15:14:43.578545 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 387/778] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:43.662146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5e23d3b2-77ab-4eb1-abd2-5892f87cd40f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:43.663582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5e23d3b2-77ab-4eb1-abd2-5892f87cd40f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:43.672138 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5e23d3b2-77ab-4eb1-abd2-5892f87cd40f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:43.672988 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5e23d3b2-77ab-4eb1-abd2-5892f87cd40f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:43.674164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5e23d3b2-77ab-4eb1-abd2-5892f87cd40f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:43.674832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5e23d3b2-77ab-4eb1-abd2-5892f87cd40f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:43.916393 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-a6286efb-6c08-4475-a651-91acc78be85e req-444b2eee-0ffa-4895-b808-0990a22bb386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399eff3a-ae28-4b3d-a00c-36e004e509da", "name": "network-vif-plugged", "status": "completed", "tag": "f7a772e1-226c-4379-8092-198295987b70"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:43.925807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-a6286efb-6c08-4475-a651-91acc78be85e req-444b2eee-0ffa-4895-b808-0990a22bb386 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:43.926258 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-a6286efb-6c08-4475-a651-91acc78be85e req-444b2eee-0ffa-4895-b808-0990a22bb386 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:43.939170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-a6286efb-6c08-4475-a651-91acc78be85e req-444b2eee-0ffa-4895-b808-0990a22bb386 service nova] Creating event network-vif-plugged:f7a772e1-226c-4379-8092-198295987b70 for instance 399eff3a-ae28-4b3d-a00c-36e004e509da on hv-cinder-78836 May 26 15:14:43.940048 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5e23d3b2-77ab-4eb1-abd2-5892f87cd40f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:43.945257 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-a6286efb-6c08-4475-a651-91acc78be85e req-444b2eee-0ffa-4895-b808-0990a22bb386 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157154 May 26 15:14:43.946281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 388/779] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:43.950604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5e23d3b2-77ab-4eb1-abd2-5892f87cd40f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1367 microversion: 2.1 time: 0.293525 May 26 15:14:43.957922 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 392/780] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:43 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:44.504783 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:44.506184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:44.513138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:44.514184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:44.514958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:44.515401 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:44.679940 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:44.694643 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:44.696439 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:44.697826 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-92b453e3-f7e5-45be-900f-7b201b15690d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1738 microversion: 2.20 time: 0.197468 May 26 15:14:44.698574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 389/781] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:44 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:44.968776 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0268f829-6841-4d81-810a-b6a3da7715fc tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:44.969392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0268f829-6841-4d81-810a-b6a3da7715fc tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:44.976938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0268f829-6841-4d81-810a-b6a3da7715fc tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:44.979193 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0268f829-6841-4d81-810a-b6a3da7715fc tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:44.980098 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0268f829-6841-4d81-810a-b6a3da7715fc tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:44.980715 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0268f829-6841-4d81-810a-b6a3da7715fc tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:45.129443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0268f829-6841-4d81-810a-b6a3da7715fc tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:45.137761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0268f829-6841-4d81-810a-b6a3da7715fc tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1367 microversion: 2.1 time: 0.173138 May 26 15:14:45.141806 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 393/782] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:44 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:45.724739 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:45.725575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:45.732957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:45.733578 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:45.734851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:45.735519 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:45.971208 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:45.985052 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:45.987815 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:45.989967 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-961ebe4a-117b-4e3c-bfb3-b1e29eabb0a7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1738 microversion: 2.20 time: 0.277441 May 26 15:14:45.991086 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 390/783] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:45 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:46.154946 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-708157e1-6465-45ff-a632-538397be2623 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:46.155576 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-708157e1-6465-45ff-a632-538397be2623 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:46.173265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-708157e1-6465-45ff-a632-538397be2623 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:46.173747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-708157e1-6465-45ff-a632-538397be2623 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:46.174737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-708157e1-6465-45ff-a632-538397be2623 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:46.175343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-708157e1-6465-45ff-a632-538397be2623 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:46.350829 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-708157e1-6465-45ff-a632-538397be2623 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:46.361977 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-708157e1-6465-45ff-a632-538397be2623 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1367 microversion: 2.1 time: 0.210704 May 26 15:14:46.362928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 394/784] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:46 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:47.019182 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:47.020794 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:47.027233 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:47.029597 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:47.031172 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:47.032036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:47.032561 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:47.182669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:47.194011 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:47.196043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:47.197332 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c8382696-e032-446b-9ad0-0bf5f7272cb7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1738 microversion: 2.20 time: 0.182258 May 26 15:14:47.197996 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 391/785] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:47 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:47.380147 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-42e0d31f-0cdf-4199-8bac-5a0a75a6be06 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:47.381414 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-42e0d31f-0cdf-4199-8bac-5a0a75a6be06 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:47.389354 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42e0d31f-0cdf-4199-8bac-5a0a75a6be06 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:47.390242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42e0d31f-0cdf-4199-8bac-5a0a75a6be06 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:47.391184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42e0d31f-0cdf-4199-8bac-5a0a75a6be06 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:47.391718 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-42e0d31f-0cdf-4199-8bac-5a0a75a6be06 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:47.571859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-42e0d31f-0cdf-4199-8bac-5a0a75a6be06 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:47.582447 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-42e0d31f-0cdf-4199-8bac-5a0a75a6be06 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1367 microversion: 2.1 time: 0.206291 May 26 15:14:47.593475 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 395/786] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:47 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:47.692646 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-d20a99b7-e0c7-47ab-8fa4-fdad9f72e64f req-e6c0ca06-5dc4-423e-8e29-429bc2a29295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7271edca-3b23-4dc4-aa5e-728df4f00cfd", "name": "network-vif-plugged", "status": "completed", "tag": "bc982787-f0cd-4e5d-9f77-626bef64840b"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:47.707572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-d20a99b7-e0c7-47ab-8fa4-fdad9f72e64f req-e6c0ca06-5dc4-423e-8e29-429bc2a29295 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:47.707572 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-d20a99b7-e0c7-47ab-8fa4-fdad9f72e64f req-e6c0ca06-5dc4-423e-8e29-429bc2a29295 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:47.724387 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-d20a99b7-e0c7-47ab-8fa4-fdad9f72e64f req-e6c0ca06-5dc4-423e-8e29-429bc2a29295 service nova] Creating event network-vif-plugged:bc982787-f0cd-4e5d-9f77-626bef64840b for instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd on hv-cinder-78836 May 26 15:14:47.729688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-d20a99b7-e0c7-47ab-8fa4-fdad9f72e64f req-e6c0ca06-5dc4-423e-8e29-429bc2a29295 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041811 May 26 15:14:47.730640 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 392/787] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:48.218858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:48.220403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:48.228376 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:48.228845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:48.229695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:48.230144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:48.391066 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:48.399695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:48.401211 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:48.402494 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d28ffa2f-bd7b-49af-85e5-d592c65d42c3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1738 microversion: 2.20 time: 0.189980 May 26 15:14:48.403065 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 396/788] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:48 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:48.600876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b0a06489-db57-465b-9d28-f91849f9e9fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:48.601668 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b0a06489-db57-465b-9d28-f91849f9e9fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:48.608396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b0a06489-db57-465b-9d28-f91849f9e9fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:48.608840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b0a06489-db57-465b-9d28-f91849f9e9fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:48.609632 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b0a06489-db57-465b-9d28-f91849f9e9fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:48.610111 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b0a06489-db57-465b-9d28-f91849f9e9fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:48.778428 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b0a06489-db57-465b-9d28-f91849f9e9fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:48.790897 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b0a06489-db57-465b-9d28-f91849f9e9fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1367 microversion: 2.1 time: 0.194666 May 26 15:14:48.791479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 393/789] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:48 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:49.427416 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:49.428020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:49.436657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:49.437141 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:49.437962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:49.438403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:49.459277 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:49.625157 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:49.634869 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:49.636718 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:49.638723 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1ed51bd5-6c2f-4801-9e4e-17310b6db2cf tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1738 microversion: 2.20 time: 0.215963 May 26 15:14:49.639671 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 397/790] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:49 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:49.809293 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c7c7739d-80c3-4270-88a0-8a56579323fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:49.810693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c7c7739d-80c3-4270-88a0-8a56579323fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:49.818207 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7c7739d-80c3-4270-88a0-8a56579323fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:49.818628 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7c7739d-80c3-4270-88a0-8a56579323fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:49.819676 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7c7739d-80c3-4270-88a0-8a56579323fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:49.820222 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7c7739d-80c3-4270-88a0-8a56579323fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:50.022501 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c7c7739d-80c3-4270-88a0-8a56579323fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:50.031061 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c7c7739d-80c3-4270-88a0-8a56579323fb tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1367 microversion: 2.1 time: 0.225871 May 26 15:14:50.041549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 394/791] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:49 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:50.658244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:50.659575 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:50.662886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:50.663792 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:50.670205 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:50.670918 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:50.671909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:50.672562 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:50.839376 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:50.850098 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:50.851625 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:50.852825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d32093d0-862d-4b0c-ba91-1552a09d9d4c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1738 microversion: 2.20 time: 0.199434 May 26 15:14:50.858948 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 398/792] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:50 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:51.058984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4bfc6725-31bc-44a9-95a5-955f0fa63430 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:51.060262 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4bfc6725-31bc-44a9-95a5-955f0fa63430 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:51.063472 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=6 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:51.068889 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4bfc6725-31bc-44a9-95a5-955f0fa63430 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:51.069351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4bfc6725-31bc-44a9-95a5-955f0fa63430 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:51.070158 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4bfc6725-31bc-44a9-95a5-955f0fa63430 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:51.070589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4bfc6725-31bc-44a9-95a5-955f0fa63430 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:51.231862 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4bfc6725-31bc-44a9-95a5-955f0fa63430 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:51.239781 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4bfc6725-31bc-44a9-95a5-955f0fa63430 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1558 microversion: 2.1 time: 0.184805 May 26 15:14:51.240666 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 395/793] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:51 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:51.259255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-07b9f4c4-aa37-48de-a70a-c68975667294 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:51.259963 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-07b9f4c4-aa37-48de-a70a-c68975667294 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:51.267127 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-07b9f4c4-aa37-48de-a70a-c68975667294 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:51.267775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-07b9f4c4-aa37-48de-a70a-c68975667294 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:51.268671 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-07b9f4c4-aa37-48de-a70a-c68975667294 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:51.269214 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-07b9f4c4-aa37-48de-a70a-c68975667294 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:51.354614 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-07b9f4c4-aa37-48de-a70a-c68975667294 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099164 May 26 15:14:51.356400 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 399/794] 10.222.0.46 () {58 vars in 1274 bytes} [Thu May 26 15:14:51 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:51.876657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:51.877600 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:51.888115 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:51.888748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:51.890212 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:51.890974 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:52.354507 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:52.362582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:52.364144 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:52.365331 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5266c220-1a3b-4c95-99b9-04e656b6d0cd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1738 microversion: 2.20 time: 0.494455 May 26 15:14:52.365917 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 396/795] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:51 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1738 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:52.692757 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-10a1b788-5c5f-49e1-8425-68d0146e1514 req-f46fac3a-506a-4489-a3d6-b1c77d9bda9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7271edca-3b23-4dc4-aa5e-728df4f00cfd", "tag": "bc982787-f0cd-4e5d-9f77-626bef64840b"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:52.697005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:52.704738 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-10a1b788-5c5f-49e1-8425-68d0146e1514 req-f46fac3a-506a-4489-a3d6-b1c77d9bda9e service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:52.705515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-10a1b788-5c5f-49e1-8425-68d0146e1514 req-f46fac3a-506a-4489-a3d6-b1c77d9bda9e service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:52.717964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-10a1b788-5c5f-49e1-8425-68d0146e1514 req-f46fac3a-506a-4489-a3d6-b1c77d9bda9e service nova] Creating event network-changed:bc982787-f0cd-4e5d-9f77-626bef64840b for instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd on hv-cinder-78836 May 26 15:14:52.723603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-10a1b788-5c5f-49e1-8425-68d0146e1514 req-f46fac3a-506a-4489-a3d6-b1c77d9bda9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035167 May 26 15:14:52.724357 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 400/796] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:53.383990 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:53.384736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:53.391704 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:53.392467 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:53.393252 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:53.393945 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:53.703484 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:53.713376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:53.714928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:53.716899 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a605b951-8bfa-4252-b9c1-78b108d9b8fb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1720 microversion: 2.20 time: 0.336170 May 26 15:14:53.717843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 397/797] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:53 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1720 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:54.663191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8576749c-5cd5-48ff-9eca-18d61046b8fe tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:54.663779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8576749c-5cd5-48ff-9eca-18d61046b8fe tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:54.670111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8576749c-5cd5-48ff-9eca-18d61046b8fe tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:54.670573 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8576749c-5cd5-48ff-9eca-18d61046b8fe tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:54.671319 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8576749c-5cd5-48ff-9eca-18d61046b8fe tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:54.671756 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8576749c-5cd5-48ff-9eca-18d61046b8fe tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:54.735268 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:54.735948 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:54.742448 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:54.742899 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:54.743964 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:54.744439 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:54.748865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:14:54.754417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-8576749c-5cd5-48ff-9eca-18d61046b8fe tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lazy-loading 'services' on Instance uuid 4682a8fb-1ed3-492f-963e-7befa1cf839d {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:14:54.832938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8576749c-5cd5-48ff-9eca-18d61046b8fe tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments/4a1633ec-6002-4edb-b4c3-f1601769f915" status: 202 len: 0 microversion: 2.1 time: 0.173927 May 26 15:14:54.834032 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 401/798] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:14:54 2022] DELETE /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments/4a1633ec-6002-4edb-b4c3-f1601769f915 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:14:54.843034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-83bedefd-732c-41c7-831a-e82560eb3c82 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:54.844673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-83bedefd-732c-41c7-831a-e82560eb3c82 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:54.853402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-83bedefd-732c-41c7-831a-e82560eb3c82 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:54.854111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-83bedefd-732c-41c7-831a-e82560eb3c82 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:54.855062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-83bedefd-732c-41c7-831a-e82560eb3c82 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:54.856287 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-83bedefd-732c-41c7-831a-e82560eb3c82 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:54.889897 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:54.891318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-83bedefd-732c-41c7-831a-e82560eb3c82 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053356 May 26 15:14:54.892094 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 402/799] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:14:54 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:14:54.898181 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:54.899684 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:54.900835 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6da397aa-71be-4ee9-8fee-01b6e8fcf63e tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1720 microversion: 2.20 time: 0.169445 May 26 15:14:54.901370 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 398/800] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:54 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:55.602047 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-099dd4a3-0d6f-468a-b2ef-3544c2b42aec req-3362e1ff-b86a-4b04-8efd-8e35ac89df03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399eff3a-ae28-4b3d-a00c-36e004e509da", "name": "network-vif-unplugged", "status": "completed", "tag": "f7a772e1-226c-4379-8092-198295987b70"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:55.619701 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-099dd4a3-0d6f-468a-b2ef-3544c2b42aec req-3362e1ff-b86a-4b04-8efd-8e35ac89df03 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:55.620146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-099dd4a3-0d6f-468a-b2ef-3544c2b42aec req-3362e1ff-b86a-4b04-8efd-8e35ac89df03 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:55.632975 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-099dd4a3-0d6f-468a-b2ef-3544c2b42aec req-3362e1ff-b86a-4b04-8efd-8e35ac89df03 service nova] Creating event network-vif-unplugged:f7a772e1-226c-4379-8092-198295987b70 for instance 399eff3a-ae28-4b3d-a00c-36e004e509da on hv-cinder-78836 May 26 15:14:55.639806 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-099dd4a3-0d6f-468a-b2ef-3544c2b42aec req-3362e1ff-b86a-4b04-8efd-8e35ac89df03 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040690 May 26 15:14:55.640459 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 403/801] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:55.902957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e94b1233-40bf-4ceb-bb3a-947434fb1540 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:55.903958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e94b1233-40bf-4ceb-bb3a-947434fb1540 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:55.913087 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e94b1233-40bf-4ceb-bb3a-947434fb1540 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:55.913562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e94b1233-40bf-4ceb-bb3a-947434fb1540 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:55.914326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e94b1233-40bf-4ceb-bb3a-947434fb1540 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:55.914876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e94b1233-40bf-4ceb-bb3a-947434fb1540 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:55.918987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:55.919748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:55.927195 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:55.927648 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:55.928424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:55.928864 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:55.952827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e94b1233-40bf-4ceb-bb3a-947434fb1540 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053375 May 26 15:14:55.953604 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 399/802] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:14:55 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:56.069807 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:56.078444 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:56.079979 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:56.081155 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e3dabeb2-3d21-4faa-90b4-c04a9b940cc4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1723 microversion: 2.20 time: 0.166879 May 26 15:14:56.081748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 404/803] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:55 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:14:56.098436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-364eb1aa-72b2-46ef-8c7d-3f53470ddb62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cbc0908-ac7e-464f-b3c4-15b0edc82998"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:56.099498 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-364eb1aa-72b2-46ef-8c7d-3f53470ddb62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:56.105435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-364eb1aa-72b2-46ef-8c7d-3f53470ddb62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.105913 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-364eb1aa-72b2-46ef-8c7d-3f53470ddb62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.106670 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-364eb1aa-72b2-46ef-8c7d-3f53470ddb62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.107102 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-364eb1aa-72b2-46ef-8c7d-3f53470ddb62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.381441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-364eb1aa-72b2-46ef-8c7d-3f53470ddb62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286827 May 26 15:14:56.382168 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 400/804] 10.222.0.46 () {62 vars in 1363 bytes} [Thu May 26 15:14:56 2022] POST /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:14:56.507087 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ca1faa6b-ab00-4112-b7c6-7cb87eda5cc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:56.507901 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ca1faa6b-ab00-4112-b7c6-7cb87eda5cc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:56.517472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca1faa6b-ab00-4112-b7c6-7cb87eda5cc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.518747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca1faa6b-ab00-4112-b7c6-7cb87eda5cc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.519683 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca1faa6b-ab00-4112-b7c6-7cb87eda5cc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.520172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ca1faa6b-ab00-4112-b7c6-7cb87eda5cc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.793426 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ca1faa6b-ab00-4112-b7c6-7cb87eda5cc0 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "DELETE /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/os-volume_attachments/0cbc0908-ac7e-464f-b3c4-15b0edc82998" status: 202 len: 0 microversion: 2.20 time: 0.291490 May 26 15:14:56.794043 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 405/805] 10.222.0.46 () {60 vars in 1456 bytes} [Thu May 26 15:14:56 2022] DELETE /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/os-volume_attachments/0cbc0908-ac7e-464f-b3c4-15b0edc82998 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:14:56.852092 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-77943dca-bc7e-4be6-b655-b7783d53a270 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:56.852675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-77943dca-bc7e-4be6-b655-b7783d53a270 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:56.859738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-77943dca-bc7e-4be6-b655-b7783d53a270 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.860180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-77943dca-bc7e-4be6-b655-b7783d53a270 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.860935 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-77943dca-bc7e-4be6-b655-b7783d53a270 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.861365 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-77943dca-bc7e-4be6-b655-b7783d53a270 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.942911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-77943dca-bc7e-4be6-b655-b7783d53a270 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "POST /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/action" status: 202 len: 0 microversion: 2.20 time: 0.094616 May 26 15:14:56.944314 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 401/806] 10.222.0.46 () {62 vars in 1318 bytes} [Thu May 26 15:14:56 2022] POST /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:14:56.951995 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:56.953683 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:56.960491 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.960953 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.961766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.962210 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.964412 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-56b6d273-e328-4468-9432-58f2eeef2159 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:56.966059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-56b6d273-e328-4468-9432-58f2eeef2159 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:56.973715 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-56b6d273-e328-4468-9432-58f2eeef2159 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.974173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-56b6d273-e328-4468-9432-58f2eeef2159 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:56.975086 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-56b6d273-e328-4468-9432-58f2eeef2159 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:56.975561 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-56b6d273-e328-4468-9432-58f2eeef2159 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:57.013231 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-56b6d273-e328-4468-9432-58f2eeef2159 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052398 May 26 15:14:57.014043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 402/807] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:14:56 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:14:57.127588 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6172f5b3-8dfb-4dbe-895d-a8e0801fbb95 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:57.128335 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6172f5b3-8dfb-4dbe-895d-a8e0801fbb95 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:57.135496 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6172f5b3-8dfb-4dbe-895d-a8e0801fbb95 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:57.136085 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6172f5b3-8dfb-4dbe-895d-a8e0801fbb95 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:57.137108 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6172f5b3-8dfb-4dbe-895d-a8e0801fbb95 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:57.137690 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6172f5b3-8dfb-4dbe-895d-a8e0801fbb95 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:57.153223 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:57.162646 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:57.164155 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:57.165313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-79514a91-b651-48b9-a1f2-f6238a7fe0bd tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1671 microversion: 2.20 time: 0.217448 May 26 15:14:57.165897 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 406/808] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:56 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1671 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:57.169635 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6172f5b3-8dfb-4dbe-895d-a8e0801fbb95 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:14:57.249882 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6172f5b3-8dfb-4dbe-895d-a8e0801fbb95 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 204 len: 0 microversion: 2.1 time: 0.126294 May 26 15:14:57.250658 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 403/809] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:14:57 2022] DELETE /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:14:57.258598 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-75b74a67-b438-4e23-844b-7849b8429291 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:57.259215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-75b74a67-b438-4e23-844b-7849b8429291 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:57.265796 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75b74a67-b438-4e23-844b-7849b8429291 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:57.266183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75b74a67-b438-4e23-844b-7849b8429291 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:57.266948 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75b74a67-b438-4e23-844b-7849b8429291 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:57.267388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-75b74a67-b438-4e23-844b-7849b8429291 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:57.403382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-75b74a67-b438-4e23-844b-7849b8429291 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:57.411457 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-75b74a67-b438-4e23-844b-7849b8429291 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1690 microversion: 2.1 time: 0.156698 May 26 15:14:57.412028 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 407/810] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:57 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:58.183707 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:58.184404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:58.191625 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:58.192068 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:58.192823 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:58.193254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:58.326122 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:58.335654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:58.337198 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:58.338360 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-86965f9e-daa2-44ad-a1c7-e95a4f6427c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1671 microversion: 2.20 time: 0.158940 May 26 15:14:58.338921 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 404/811] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:58 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:58.428375 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6e7b2b9f-5c3d-4c5e-9680-54721b360f8e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:58.428984 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6e7b2b9f-5c3d-4c5e-9680-54721b360f8e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:58.435434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e7b2b9f-5c3d-4c5e-9680-54721b360f8e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:58.436333 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e7b2b9f-5c3d-4c5e-9680-54721b360f8e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:58.437082 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e7b2b9f-5c3d-4c5e-9680-54721b360f8e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:58.437548 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e7b2b9f-5c3d-4c5e-9680-54721b360f8e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:58.570957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6e7b2b9f-5c3d-4c5e-9680-54721b360f8e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:58.579014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6e7b2b9f-5c3d-4c5e-9680-54721b360f8e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1690 microversion: 2.1 time: 0.154459 May 26 15:14:58.579566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 408/812] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:58 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:59.356842 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:59.357466 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:59.364798 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:59.365246 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:59.366107 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:59.366543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:59.492735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:59.501186 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:59.502742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:59.503887 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7db72aa6-7ac8-4b5f-add4-0078fc11ce4f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1671 microversion: 2.20 time: 0.151138 May 26 15:14:59.504443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 405/813] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:14:59 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:14:59.596553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8ac67ec1-b734-4df9-9db2-1f6d5c5d07c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:59.597172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8ac67ec1-b734-4df9-9db2-1f6d5c5d07c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:14:59.603711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ac67ec1-b734-4df9-9db2-1f6d5c5d07c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:59.604168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ac67ec1-b734-4df9-9db2-1f6d5c5d07c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:59.604928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ac67ec1-b734-4df9-9db2-1f6d5c5d07c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:14:59.605361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8ac67ec1-b734-4df9-9db2-1f6d5c5d07c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:14:59.735642 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8ac67ec1-b734-4df9-9db2-1f6d5c5d07c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:59.743008 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8ac67ec1-b734-4df9-9db2-1f6d5c5d07c5 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1690 microversion: 2.1 time: 0.150924 May 26 15:14:59.743841 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 409/814] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:14:59 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:00.522477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:00.523025 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:00.529938 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:00.530387 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:00.531139 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:00.531571 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:00.665055 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:00.673688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:00.675233 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:00.676398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7ec13952-13cd-41b6-9ef1-730905372e1d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1673 microversion: 2.20 time: 0.157943 May 26 15:15:00.677014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 406/815] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:00 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:00.764507 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e3b85d2e-f68f-4fab-9783-a7573f8e9bfd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:00.765634 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e3b85d2e-f68f-4fab-9783-a7573f8e9bfd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:00.777391 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e3b85d2e-f68f-4fab-9783-a7573f8e9bfd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:00.778133 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e3b85d2e-f68f-4fab-9783-a7573f8e9bfd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:00.780015 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e3b85d2e-f68f-4fab-9783-a7573f8e9bfd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:00.780736 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e3b85d2e-f68f-4fab-9783-a7573f8e9bfd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:01.052171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e3b85d2e-f68f-4fab-9783-a7573f8e9bfd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:01.059801 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e3b85d2e-f68f-4fab-9783-a7573f8e9bfd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1690 microversion: 2.1 time: 0.302766 May 26 15:15:01.060464 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 410/816] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:00 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1690 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:01.694951 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:01.695565 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:01.702327 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:01.702778 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:01.703549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:01.703984 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:02.076172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-68e64d8e-d63b-4fd7-9a23-524022aaa8b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:02.076792 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-68e64d8e-d63b-4fd7-9a23-524022aaa8b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:02.083420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-68e64d8e-d63b-4fd7-9a23-524022aaa8b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:02.083896 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-68e64d8e-d63b-4fd7-9a23-524022aaa8b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:02.084693 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-68e64d8e-d63b-4fd7-9a23-524022aaa8b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:02.085125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-68e64d8e-d63b-4fd7-9a23-524022aaa8b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:02.222386 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-68e64d8e-d63b-4fd7-9a23-524022aaa8b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:02.228836 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:02.230293 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-68e64d8e-d63b-4fd7-9a23-524022aaa8b4 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 200 len: 1623 microversion: 2.1 time: 0.158009 May 26 15:15:02.230955 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 411/817] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:02 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 1623 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:02.237789 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:02.239461 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:02.240797 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-02bce62c-bc4c-4d5b-b9cc-b8c0c976a968 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.549681 May 26 15:15:02.241666 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 407/818] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:01 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:02.400008 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-2bd9b630-c564-4177-a3b1-5b2e589baaa1 req-8e194a96-8d6c-4de2-be98-e609935a7684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4682a8fb-1ed3-492f-963e-7befa1cf839d", "name": "network-vif-deleted", "tag": "af1b1d4b-d86d-4d01-b349-f19b08f5f132"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:02.409418 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-2bd9b630-c564-4177-a3b1-5b2e589baaa1 req-8e194a96-8d6c-4de2-be98-e609935a7684 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:02.409418 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-2bd9b630-c564-4177-a3b1-5b2e589baaa1 req-8e194a96-8d6c-4de2-be98-e609935a7684 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:02.421669 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-2bd9b630-c564-4177-a3b1-5b2e589baaa1 req-8e194a96-8d6c-4de2-be98-e609935a7684 service nova] Creating event network-vif-deleted:af1b1d4b-d86d-4d01-b349-f19b08f5f132 for instance 4682a8fb-1ed3-492f-963e-7befa1cf839d on hv-cinder-78836 May 26 15:15:02.427037 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-2bd9b630-c564-4177-a3b1-5b2e589baaa1 req-8e194a96-8d6c-4de2-be98-e609935a7684 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030936 May 26 15:15:02.427637 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 412/819] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:03.248809 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:03.249484 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 4682a8fb-1ed3-492f-963e-7befa1cf839d] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:03.262121 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:03.262721 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:03.262721 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:03.263591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:03.264114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:03.264960 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:03.282604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:03.283384 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:03.284466 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:03.285120 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:03.290099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:03.302468 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] HTTP exception thrown: Instance 4682a8fb-1ed3-492f-963e-7befa1cf839d could not be found. May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Request method failure captured: May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d HTTP/1.1 May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5hRvwCh_0EjDjPJrKGPN-nNnnn3ra8nC-wiV8Z3ZLol3S-_v1z_BoI1WppEzWWOsw2KXu-v_YyNZ8AZKmicfOwsWNz89ANHmuHTiYJbSDuKqzhbIZKw2QZmRDOpCH9qB6dPcgVEuqPBsWBqUu-lMOyym4jaYon5YIfCwIEe5Ro_pMw May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:15:03.306123 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_45e3fe61cc704411ac645e5935b9d258", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/45e3fe61cc704411ac645e5935b9d258"}]}] May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 27172e53a12a437c9d57a75a95727d71 May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 4682a8fb-1ed3-492f-963e-7befa1cf839d could not be found. May 26 15:15:03.307774 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '4682a8fb-1ed3-492f-963e-7befa1cf839d'} May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4682a8fb-1ed3-492f-963e-7befa1cf839d could not be found. May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:03.308767 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4682a8fb-1ed3-492f-963e-7befa1cf839d could not be found. May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4682a8fb-1ed3-492f-963e-7befa1cf839d could not be found. May 26 15:15:03.310517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:03.313601 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Returning 404 to user: Instance 4682a8fb-1ed3-492f-963e-7befa1cf839d could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:03.317523 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c7065592-08a8-4b67-bccb-c05d2bf61333 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d" status: 404 len: 111 microversion: 2.1 time: 0.072786 May 26 15:15:03.320733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 408/820] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:03 2022] GET /compute/v2.1/servers/4682a8fb-1ed3-492f-963e-7befa1cf839d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:03.333591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ba7c0d6e-e5aa-4561-955f-c3db3e7e1ba1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '.version_select at 0x7ff9658189d0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:03.378828 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ba7c0d6e-e5aa-4561-955f-c3db3e7e1ba1 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146116841" status: 202 len: 0 microversion: 2.1 time: 0.055059 May 26 15:15:03.382472 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 409/821] 10.222.0.46 () {58 vars in 1220 bytes} [Thu May 26 15:15:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2146116841 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:03.476988 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:03.491258 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:03.492754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:03.495362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fd54bdf3-d1d8-4443-9b75-083aa6694695 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.239213 May 26 15:15:03.496171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 413/822] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:03 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:04.515169 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:04.516369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:04.524451 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:04.524911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:04.525942 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:04.526394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:04.699394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:04.715079 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:04.718519 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:04.721059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ce4fd42c-c4cf-4e3a-88a5-9144354f99ec tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.210265 May 26 15:15:04.722666 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 410/823] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:04 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:05.741985 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:05.742870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:05.750268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:05.750720 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:05.751683 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:05.752119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:05.922313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:05.931095 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:05.932617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:05.933842 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-094c6657-47f3-4e78-93e8-4535ebdac516 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.196689 May 26 15:15:05.944732 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 414/824] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:05 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:06.928268 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4c3c33da-a494-4839-add5-80e8d468bf8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:06.929139 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4c3c33da-a494-4839-add5-80e8d468bf8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:06.935751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4c3c33da-a494-4839-add5-80e8d468bf8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:06.936285 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4c3c33da-a494-4839-add5-80e8d468bf8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:06.937132 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4c3c33da-a494-4839-add5-80e8d468bf8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:06.937609 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4c3c33da-a494-4839-add5-80e8d468bf8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:06.942009 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:06.952655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:06.954190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:06.964405 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:06.965215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:06.966304 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:06.967700 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4c3c33da-a494-4839-add5-80e8d468bf8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:15:06.967862 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:07.104175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4c3c33da-a494-4839-add5-80e8d468bf8a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 204 len: 0 microversion: 2.1 time: 0.179542 May 26 15:15:07.104954 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 411/825] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:06 2022] DELETE /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:07.114244 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-de996c08-2642-4b76-8ee6-248cad5023ef tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:07.115045 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-de996c08-2642-4b76-8ee6-248cad5023ef tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:07.134518 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-de996c08-2642-4b76-8ee6-248cad5023ef tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:07.135318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-de996c08-2642-4b76-8ee6-248cad5023ef tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:07.136516 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-de996c08-2642-4b76-8ee6-248cad5023ef tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:07.137085 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-de996c08-2642-4b76-8ee6-248cad5023ef tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:07.168948 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:07.178432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:07.179969 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:07.181162 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c2adb72d-2827-4ce0-8bc5-e93c39345120 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.233068 May 26 15:15:07.192031 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 415/826] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:06 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:07.314597 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-de996c08-2642-4b76-8ee6-248cad5023ef tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:07.330759 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-de996c08-2642-4b76-8ee6-248cad5023ef tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1508 microversion: 2.1 time: 0.221155 May 26 15:15:07.331369 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 412/827] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:07 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:08.200712 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:08.201538 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:08.209438 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:08.209971 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:08.210798 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:08.211319 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:08.348099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3f26cf2b-fd9d-4102-b376-0c3b54d950da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:08.348977 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3f26cf2b-fd9d-4102-b376-0c3b54d950da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:08.356676 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3f26cf2b-fd9d-4102-b376-0c3b54d950da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:08.357394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3f26cf2b-fd9d-4102-b376-0c3b54d950da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:08.359026 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3f26cf2b-fd9d-4102-b376-0c3b54d950da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:08.359766 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3f26cf2b-fd9d-4102-b376-0c3b54d950da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:08.363572 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:08.373630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:08.375500 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:08.377556 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-52d6bee0-f51e-44ab-a278-a89031d46978 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.181005 May 26 15:15:08.378658 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 416/828] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:08 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:08.501873 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3f26cf2b-fd9d-4102-b376-0c3b54d950da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:08.509339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3f26cf2b-fd9d-4102-b376-0c3b54d950da tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1508 microversion: 2.1 time: 0.166314 May 26 15:15:08.512903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 413/829] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:08 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:08.855450 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-49e91d1f-6902-47ba-926b-b2fb7835b76c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:08.858448 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-49e91d1f-6902-47ba-926b-b2fb7835b76c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:08.863210 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49e91d1f-6902-47ba-926b-b2fb7835b76c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:08.863660 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49e91d1f-6902-47ba-926b-b2fb7835b76c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:08.864422 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49e91d1f-6902-47ba-926b-b2fb7835b76c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:08.864858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-49e91d1f-6902-47ba-926b-b2fb7835b76c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:08.887265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-49e91d1f-6902-47ba-926b-b2fb7835b76c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lazy-loading 'flavor' on Instance uuid 6a80f2c7-1451-47b7-9f5e-3d53c21794ae {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:08.969108 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-49e91d1f-6902-47ba-926b-b2fb7835b76c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "POST /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae/action" status: 202 len: 0 microversion: 2.1 time: 0.117369 May 26 15:15:08.970074 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 417/830] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:15:08 2022] POST /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:08.978197 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-121a1157-3195-412e-a739-8432d1a3f590 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:08.978944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-121a1157-3195-412e-a739-8432d1a3f590 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:08.989875 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-121a1157-3195-412e-a739-8432d1a3f590 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:08.990838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-121a1157-3195-412e-a739-8432d1a3f590 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:08.992332 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-121a1157-3195-412e-a739-8432d1a3f590 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:08.992842 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-121a1157-3195-412e-a739-8432d1a3f590 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:09.006823 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-da723182-9bfc-415e-8478-6c23939344c0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:09.007408 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-da723182-9bfc-415e-8478-6c23939344c0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:09.014172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-da723182-9bfc-415e-8478-6c23939344c0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:09.014634 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-da723182-9bfc-415e-8478-6c23939344c0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:09.015404 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-da723182-9bfc-415e-8478-6c23939344c0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:09.015842 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-da723182-9bfc-415e-8478-6c23939344c0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:09.042464 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-da723182-9bfc-415e-8478-6c23939344c0 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/ips" status: 200 len: 145 microversion: 2.1 time: 0.039936 May 26 15:15:09.043056 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 418/831] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:15:09 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:15:09.193695 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-121a1157-3195-412e-a739-8432d1a3f590 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:09.203272 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-121a1157-3195-412e-a739-8432d1a3f590 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.228949 May 26 15:15:09.204335 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 414/832] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:08 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:09.397047 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:09.397886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:09.406647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:09.407452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:09.408606 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:09.409254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:09.529999 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c3f1fdb6-b125-4898-9255-eb9c4c251384 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:09.530628 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c3f1fdb6-b125-4898-9255-eb9c4c251384 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:09.537871 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c3f1fdb6-b125-4898-9255-eb9c4c251384 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:09.538371 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c3f1fdb6-b125-4898-9255-eb9c4c251384 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:09.539152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c3f1fdb6-b125-4898-9255-eb9c4c251384 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:09.539598 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c3f1fdb6-b125-4898-9255-eb9c4c251384 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:09.561957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:09.571941 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:09.573743 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:09.575617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ee4d4ac7-8d87-4fa3-ae5a-8737afb19b95 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.183433 May 26 15:15:09.576447 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 419/833] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:09 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:09.757149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c3f1fdb6-b125-4898-9255-eb9c4c251384 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:09.787890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c3f1fdb6-b125-4898-9255-eb9c4c251384 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1508 microversion: 2.1 time: 0.254270 May 26 15:15:09.788541 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 415/834] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:09 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:10.222070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-054d0fa7-e938-4ecf-8683-2228c5f7454c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:10.223449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-054d0fa7-e938-4ecf-8683-2228c5f7454c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:10.231082 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-054d0fa7-e938-4ecf-8683-2228c5f7454c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:10.232052 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-054d0fa7-e938-4ecf-8683-2228c5f7454c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:10.233386 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-054d0fa7-e938-4ecf-8683-2228c5f7454c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:10.234181 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-054d0fa7-e938-4ecf-8683-2228c5f7454c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:10.383902 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-054d0fa7-e938-4ecf-8683-2228c5f7454c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:10.392450 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-054d0fa7-e938-4ecf-8683-2228c5f7454c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.174817 May 26 15:15:10.403045 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 420/835] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:10 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:10.436629 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b76b4aa0-24b4-461e-a715-7033585213d5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b05eac4-4e9f-4c7c-b187-43bd0ad2551d"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:10.438071 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b76b4aa0-24b4-461e-a715-7033585213d5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:10.444465 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b76b4aa0-24b4-461e-a715-7033585213d5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:10.444913 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b76b4aa0-24b4-461e-a715-7033585213d5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:10.445885 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b76b4aa0-24b4-461e-a715-7033585213d5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:10.446321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b76b4aa0-24b4-461e-a715-7033585213d5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:10.602795 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:10.606346 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:10.627992 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:10.627992 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:10.628744 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:10.629504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:10.798313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:10.807523 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:10.809193 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:10.811042 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5bb121e0-c247-4aec-b357-8ca4b65594ae tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.219157 May 26 15:15:10.811603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 421/836] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:10 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:10.816378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-66360e7d-50f4-4f47-ad07-b512ad357e6a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:10.817194 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-66360e7d-50f4-4f47-ad07-b512ad357e6a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:10.823729 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66360e7d-50f4-4f47-ad07-b512ad357e6a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:10.824184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66360e7d-50f4-4f47-ad07-b512ad357e6a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:10.824999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66360e7d-50f4-4f47-ad07-b512ad357e6a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:10.825381 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-66360e7d-50f4-4f47-ad07-b512ad357e6a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:10.982919 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-66360e7d-50f4-4f47-ad07-b512ad357e6a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:11.000546 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-66360e7d-50f4-4f47-ad07-b512ad357e6a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1508 microversion: 2.1 time: 0.187402 May 26 15:15:11.001176 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 422/837] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:10 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1508 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:11.411747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6baa8fcf-cf53-42ce-baff-73988bd2fdd7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:11.413716 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6baa8fcf-cf53-42ce-baff-73988bd2fdd7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:11.420296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6baa8fcf-cf53-42ce-baff-73988bd2fdd7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.420737 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6baa8fcf-cf53-42ce-baff-73988bd2fdd7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.421535 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6baa8fcf-cf53-42ce-baff-73988bd2fdd7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.421982 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6baa8fcf-cf53-42ce-baff-73988bd2fdd7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.565740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6baa8fcf-cf53-42ce-baff-73988bd2fdd7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:11.573429 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6baa8fcf-cf53-42ce-baff-73988bd2fdd7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.166397 May 26 15:15:11.574025 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 423/838] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:11 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:11.829734 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:11.830442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:11.836972 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.837431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.838238 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:11.838678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:11.973615 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:11.981484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:11.983749 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:11.984755 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ed64b753-8a21-4fc0-b8f5-bbe2b3c0a81b tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.159101 May 26 15:15:11.985375 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 424/839] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:11 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:12.017016 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-e57abf8d-7c09-4c62-81a1-58a11a2e0fe2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:12.017656 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-e57abf8d-7c09-4c62-81a1-58a11a2e0fe2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:12.023461 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e57abf8d-7c09-4c62-81a1-58a11a2e0fe2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:12.023921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e57abf8d-7c09-4c62-81a1-58a11a2e0fe2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:12.024681 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e57abf8d-7c09-4c62-81a1-58a11a2e0fe2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:12.025119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-e57abf8d-7c09-4c62-81a1-58a11a2e0fe2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:12.162469 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-e57abf8d-7c09-4c62-81a1-58a11a2e0fe2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:12.170449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-e57abf8d-7c09-4c62-81a1-58a11a2e0fe2 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1508 microversion: 2.1 time: 0.156985 May 26 15:15:12.171020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 425/840] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:12 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:12.592238 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c3493028-44bc-42fb-bae9-2e5b28eb7e6e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:12.592930 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c3493028-44bc-42fb-bae9-2e5b28eb7e6e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:12.599049 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3493028-44bc-42fb-bae9-2e5b28eb7e6e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:12.599499 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3493028-44bc-42fb-bae9-2e5b28eb7e6e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:12.600262 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3493028-44bc-42fb-bae9-2e5b28eb7e6e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:12.600697 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-c3493028-44bc-42fb-bae9-2e5b28eb7e6e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:12.733661 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c3493028-44bc-42fb-bae9-2e5b28eb7e6e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:12.741070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c3493028-44bc-42fb-bae9-2e5b28eb7e6e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.152745 May 26 15:15:12.741669 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 426/841] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:12 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:13.003149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:13.003702 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:13.010101 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:13.010545 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:13.011301 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:13.011738 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:13.144374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:13.152123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:13.153672 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:13.154818 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-31c4c37b-0476-4bfb-bd14-bbc20c39ab06 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.155698 May 26 15:15:13.155371 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 427/842] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:12 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:13.187561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6af1d603-6878-40e3-8ebc-ac7033bc98a0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:13.188175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6af1d603-6878-40e3-8ebc-ac7033bc98a0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:13.194226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6af1d603-6878-40e3-8ebc-ac7033bc98a0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:13.194678 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6af1d603-6878-40e3-8ebc-ac7033bc98a0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:13.195439 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6af1d603-6878-40e3-8ebc-ac7033bc98a0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:13.195892 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6af1d603-6878-40e3-8ebc-ac7033bc98a0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:13.199868 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:13.326317 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6af1d603-6878-40e3-8ebc-ac7033bc98a0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:13.333798 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6af1d603-6878-40e3-8ebc-ac7033bc98a0 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1508 microversion: 2.1 time: 0.150584 May 26 15:15:13.334361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 428/843] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:13 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:13.759647 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4f2cbc09-d7ff-4847-9962-9687851226f9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:13.760309 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4f2cbc09-d7ff-4847-9962-9687851226f9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:13.766314 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f2cbc09-d7ff-4847-9962-9687851226f9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:13.766858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f2cbc09-d7ff-4847-9962-9687851226f9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:13.767813 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f2cbc09-d7ff-4847-9962-9687851226f9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:13.768265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4f2cbc09-d7ff-4847-9962-9687851226f9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:13.901733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4f2cbc09-d7ff-4847-9962-9687851226f9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:13.909367 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4f2cbc09-d7ff-4847-9962-9687851226f9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.153616 May 26 15:15:13.909960 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 429/844] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:13 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:14.173277 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:14.173835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:14.180384 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.180827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.181791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.182226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.316003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:14.324189 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:14.325766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:14.326957 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bb84f909-3b4f-4279-8f05-07a7934348bb tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.158754 May 26 15:15:14.327555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 430/845] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:14 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:14.351039 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7aa3f24a-ffff-4fda-ab7c-d9291263e22d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:14.351655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7aa3f24a-ffff-4fda-ab7c-d9291263e22d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:14.358629 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7aa3f24a-ffff-4fda-ab7c-d9291263e22d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.359080 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7aa3f24a-ffff-4fda-ab7c-d9291263e22d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.359851 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7aa3f24a-ffff-4fda-ab7c-d9291263e22d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.360292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7aa3f24a-ffff-4fda-ab7c-d9291263e22d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.501652 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7aa3f24a-ffff-4fda-ab7c-d9291263e22d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:14.509576 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7aa3f24a-ffff-4fda-ab7c-d9291263e22d tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1508 microversion: 2.1 time: 0.162056 May 26 15:15:14.510168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 431/846] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:14 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:14.543107 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b76b4aa0-24b4-461e-a715-7033585213d5 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.110787 May 26 15:15:14.543758 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 416/847] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:15:10 2022] POST /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments => generated 194 bytes in 4112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:15:14.926577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-91bf7df6-60f2-4ed9-b392-14ca82b31c4f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:14.927192 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-91bf7df6-60f2-4ed9-b392-14ca82b31c4f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:14.933185 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91bf7df6-60f2-4ed9-b392-14ca82b31c4f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.933844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91bf7df6-60f2-4ed9-b392-14ca82b31c4f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:14.934603 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91bf7df6-60f2-4ed9-b392-14ca82b31c4f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:14.935594 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-91bf7df6-60f2-4ed9-b392-14ca82b31c4f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.063352 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-91bf7df6-60f2-4ed9-b392-14ca82b31c4f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:15.070784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-91bf7df6-60f2-4ed9-b392-14ca82b31c4f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.148095 May 26 15:15:15.071346 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 432/848] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:14 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:15.346342 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:15.347067 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:15.353354 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.353830 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.354619 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.355054 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.526846 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3f2c902a-ba93-455d-be02-9235c5e5a196 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:15.527457 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3f2c902a-ba93-455d-be02-9235c5e5a196 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:15.534849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f2c902a-ba93-455d-be02-9235c5e5a196 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.535318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f2c902a-ba93-455d-be02-9235c5e5a196 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.537123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f2c902a-ba93-455d-be02-9235c5e5a196 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:15.537123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f2c902a-ba93-455d-be02-9235c5e5a196 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:15.567393 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:15.577614 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:15.579370 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:15.580686 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b1d3c4f5-7681-4be2-ab9b-fcf759640fd5 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.239226 May 26 15:15:15.581367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 417/849] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:15 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:15.772274 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3f2c902a-ba93-455d-be02-9235c5e5a196 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:15.780649 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3f2c902a-ba93-455d-be02-9235c5e5a196 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 200 len: 1508 microversion: 2.1 time: 0.257534 May 26 15:15:15.781316 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 433/850] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:15 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:16.020099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-20cf8a1a-3df1-40a4-83e2-699f4e6e57aa req-757efd4f-0b66-4536-93a4-25ba857ee899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240f19f3-04d8-4c10-a376-0f18377ee00a", "name": "network-vif-deleted", "tag": "dc0d1f46-3f16-4656-8246-5fefd8f4774a"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:16.031540 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-20cf8a1a-3df1-40a4-83e2-699f4e6e57aa req-757efd4f-0b66-4536-93a4-25ba857ee899 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.032366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-20cf8a1a-3df1-40a4-83e2-699f4e6e57aa req-757efd4f-0b66-4536-93a4-25ba857ee899 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.047119 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-20cf8a1a-3df1-40a4-83e2-699f4e6e57aa req-757efd4f-0b66-4536-93a4-25ba857ee899 service nova] Creating event network-vif-deleted:dc0d1f46-3f16-4656-8246-5fefd8f4774a for instance 240f19f3-04d8-4c10-a376-0f18377ee00a on hv-cinder-78836 May 26 15:15:16.052232 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-20cf8a1a-3df1-40a4-83e2-699f4e6e57aa req-757efd4f-0b66-4536-93a4-25ba857ee899 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044583 May 26 15:15:16.052970 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 418/851] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:16.088872 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cf3d6430-76ca-4b95-8f11-ade1ac77b76b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:16.089549 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cf3d6430-76ca-4b95-8f11-ade1ac77b76b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:16.097235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cf3d6430-76ca-4b95-8f11-ade1ac77b76b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.098285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cf3d6430-76ca-4b95-8f11-ade1ac77b76b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.100619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cf3d6430-76ca-4b95-8f11-ade1ac77b76b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.101078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cf3d6430-76ca-4b95-8f11-ade1ac77b76b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.273016 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cf3d6430-76ca-4b95-8f11-ade1ac77b76b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:16.282178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cf3d6430-76ca-4b95-8f11-ade1ac77b76b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.197381 May 26 15:15:16.284290 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 434/852] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:16 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:16.600751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:16.601472 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:16.607934 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.608432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.609688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.610301 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.772246 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:16.780870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:16.782772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:16.784095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b49b69da-1a03-4e2a-bc8a-d3cfea0c5e62 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.187753 May 26 15:15:16.784643 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 419/853] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:16 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:16.798176 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:16.798999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: 240f19f3-04d8-4c10-a376-0f18377ee00a] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:16.805770 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.806224 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.807000 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.807437 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.821715 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] HTTP exception thrown: Instance 240f19f3-04d8-4c10-a376-0f18377ee00a could not be found. May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Request method failure captured: May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a HTTP/1.1 May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5hRvwCh_0EjDjPJrKGPN-nNnnn3ra8nC-wiV8Z3ZLol3S-_v1z_BoI1WppEzWWOsw2KXu-v_YyNZ8AZKmicfOwsWNz89ANHmuHTiYJbSDuKqzhbIZKw2QZmRDOpCH9qB6dPcgVEuqPBsWBqUu-lMOyym4jaYon5YIfCwIEe5Ro_pMw May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:16.823424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_45e3fe61cc704411ac645e5935b9d258", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/45e3fe61cc704411ac645e5935b9d258"}]}] May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 27172e53a12a437c9d57a75a95727d71 May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 240f19f3-04d8-4c10-a376-0f18377ee00a could not be found. May 26 15:15:16.825071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '240f19f3-04d8-4c10-a376-0f18377ee00a'} May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240f19f3-04d8-4c10-a376-0f18377ee00a could not be found. May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:16.825994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240f19f3-04d8-4c10-a376-0f18377ee00a could not be found. May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240f19f3-04d8-4c10-a376-0f18377ee00a could not be found. May 26 15:15:16.827455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:16.828682 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Returning 404 to user: Instance 240f19f3-04d8-4c10-a376-0f18377ee00a could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:16.828682 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-182fe5ad-a879-4b00-a6eb-f711e060de28 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a" status: 404 len: 111 microversion: 2.1 time: 0.031054 May 26 15:15:16.828682 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 435/854] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:16 2022] GET /compute/v2.1/servers/240f19f3-04d8-4c10-a376-0f18377ee00a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:16.833687 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5f47d212-f972-4825-a710-61b28cdd9357 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:16.835265 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5f47d212-f972-4825-a710-61b28cdd9357 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:16.842443 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f47d212-f972-4825-a710-61b28cdd9357 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.842844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f47d212-f972-4825-a710-61b28cdd9357 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.843603 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f47d212-f972-4825-a710-61b28cdd9357 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.844084 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5f47d212-f972-4825-a710-61b28cdd9357 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.869713 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5f47d212-f972-4825-a710-61b28cdd9357 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:15:16.949658 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5f47d212-f972-4825-a710-61b28cdd9357 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 204 len: 0 microversion: 2.1 time: 0.119812 May 26 15:15:16.950385 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 420/855] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:16 2022] DELETE /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:16.958527 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5c6da13c-08c6-4d75-b577-95bd49296c43 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:16.959144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5c6da13c-08c6-4d75-b577-95bd49296c43 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:16.965289 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c6da13c-08c6-4d75-b577-95bd49296c43 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.965717 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c6da13c-08c6-4d75-b577-95bd49296c43 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:16.966622 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c6da13c-08c6-4d75-b577-95bd49296c43 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:16.967988 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c6da13c-08c6-4d75-b577-95bd49296c43 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.104072 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5c6da13c-08c6-4d75-b577-95bd49296c43 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:17.112160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5c6da13c-08c6-4d75-b577-95bd49296c43 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.157564 May 26 15:15:17.112724 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 436/856] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:16 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:17.303038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-13298141-2b3d-4cf5-a4e2-40349194d5ca tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:17.304158 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-13298141-2b3d-4cf5-a4e2-40349194d5ca tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:17.306440 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:17.313280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13298141-2b3d-4cf5-a4e2-40349194d5ca tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.313758 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13298141-2b3d-4cf5-a4e2-40349194d5ca tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.314558 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13298141-2b3d-4cf5-a4e2-40349194d5ca tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.315002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-13298141-2b3d-4cf5-a4e2-40349194d5ca tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.460454 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-13298141-2b3d-4cf5-a4e2-40349194d5ca tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:17.469265 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-13298141-2b3d-4cf5-a4e2-40349194d5ca tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.170532 May 26 15:15:17.469914 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 421/857] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:17 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:17.802827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:17.803452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:17.810866 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.811350 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.812111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:17.812553 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:17.963296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:17.973516 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:17.975020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:17.976202 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-62254e54-b881-4aa2-aebc-f436935c97c8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.177614 May 26 15:15:17.976792 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 437/858] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:17 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:18.129532 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-490ba571-d39d-43b4-9a2f-68a66e76b20e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:18.130152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-490ba571-d39d-43b4-9a2f-68a66e76b20e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:18.136878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-490ba571-d39d-43b4-9a2f-68a66e76b20e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.137322 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-490ba571-d39d-43b4-9a2f-68a66e76b20e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.138676 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-490ba571-d39d-43b4-9a2f-68a66e76b20e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.139114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-490ba571-d39d-43b4-9a2f-68a66e76b20e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.291896 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-490ba571-d39d-43b4-9a2f-68a66e76b20e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:18.310535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-490ba571-d39d-43b4-9a2f-68a66e76b20e tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.184226 May 26 15:15:18.311237 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 422/859] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:18 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:18.486966 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6e07f8d6-ac8d-485d-ae3d-11532bcb8a35 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:18.487517 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6e07f8d6-ac8d-485d-ae3d-11532bcb8a35 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:18.493940 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e07f8d6-ac8d-485d-ae3d-11532bcb8a35 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.494393 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e07f8d6-ac8d-485d-ae3d-11532bcb8a35 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.495167 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e07f8d6-ac8d-485d-ae3d-11532bcb8a35 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:18.495606 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e07f8d6-ac8d-485d-ae3d-11532bcb8a35 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:18.661706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6e07f8d6-ac8d-485d-ae3d-11532bcb8a35 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:18.671285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6e07f8d6-ac8d-485d-ae3d-11532bcb8a35 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.188449 May 26 15:15:18.671868 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 438/860] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:18 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:18.995062 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:18.995682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:19.002717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.003198 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.004061 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.004497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.143170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:19.146737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:19.152368 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:19.154010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:19.155206 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-708d768e-5ae1-49ef-b5e3-e8dce21a3cea tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.164411 May 26 15:15:19.155815 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 423/861] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:18 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:19.327551 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-189e1434-9aae-4875-a7b5-1add640777bd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:19.328168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-189e1434-9aae-4875-a7b5-1add640777bd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:19.335145 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-189e1434-9aae-4875-a7b5-1add640777bd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.335595 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-189e1434-9aae-4875-a7b5-1add640777bd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.336368 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-189e1434-9aae-4875-a7b5-1add640777bd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.336807 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-189e1434-9aae-4875-a7b5-1add640777bd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.470892 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-189e1434-9aae-4875-a7b5-1add640777bd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:19.478717 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-189e1434-9aae-4875-a7b5-1add640777bd tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.154996 May 26 15:15:19.479283 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 439/862] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:19 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:19.690409 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-31c881c3-5f90-4906-95d2-d83404e7d272 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:19.690966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-31c881c3-5f90-4906-95d2-d83404e7d272 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:19.699018 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-31c881c3-5f90-4906-95d2-d83404e7d272 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.699477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-31c881c3-5f90-4906-95d2-d83404e7d272 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.700122 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-f76380c7-58e3-449b-87be-7d01d8400e72 req-8bdbb635-81e2-41d0-9fea-50f5ed7c007c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399eff3a-ae28-4b3d-a00c-36e004e509da", "name": "network-vif-plugged", "status": "completed", "tag": "f7a772e1-226c-4379-8092-198295987b70"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:19.701761 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-31c881c3-5f90-4906-95d2-d83404e7d272 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.702365 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-31c881c3-5f90-4906-95d2-d83404e7d272 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.710887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f76380c7-58e3-449b-87be-7d01d8400e72 req-8bdbb635-81e2-41d0-9fea-50f5ed7c007c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:19.711459 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f76380c7-58e3-449b-87be-7d01d8400e72 req-8bdbb635-81e2-41d0-9fea-50f5ed7c007c service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:19.723068 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-f76380c7-58e3-449b-87be-7d01d8400e72 req-8bdbb635-81e2-41d0-9fea-50f5ed7c007c service nova] Creating event network-vif-plugged:f7a772e1-226c-4379-8092-198295987b70 for instance 399eff3a-ae28-4b3d-a00c-36e004e509da on hv-cinder-78836 May 26 15:15:19.728238 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-f76380c7-58e3-449b-87be-7d01d8400e72 req-8bdbb635-81e2-41d0-9fea-50f5ed7c007c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032239 May 26 15:15:19.728954 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 440/863] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:19.850785 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-31c881c3-5f90-4906-95d2-d83404e7d272 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:19.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-31c881c3-5f90-4906-95d2-d83404e7d272 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.173653 May 26 15:15:19.859716 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 424/864] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:19 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:20.177980 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:20.178991 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:20.186065 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.186562 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.187356 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.187828 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.471487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:20.479911 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:20.481430 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:20.482634 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1c039658-5bf9-4a55-8904-a1df2d4a1d9c tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.311813 May 26 15:15:20.483201 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 441/865] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:20 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:20.496562 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4b4060f7-efad-4360-be77-a4f5d28b8ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:20.497268 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4b4060f7-efad-4360-be77-a4f5d28b8ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:20.506947 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4b4060f7-efad-4360-be77-a4f5d28b8ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.507409 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4b4060f7-efad-4360-be77-a4f5d28b8ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.508237 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4b4060f7-efad-4360-be77-a4f5d28b8ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.508688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4b4060f7-efad-4360-be77-a4f5d28b8ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.695907 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4b4060f7-efad-4360-be77-a4f5d28b8ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:20.704097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4b4060f7-efad-4360-be77-a4f5d28b8ecc tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1522 microversion: 2.1 time: 0.211902 May 26 15:15:20.704675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 425/866] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:20 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:20.882998 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-79c33149-046e-450d-a094-156092d44fed tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:20.884212 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-79c33149-046e-450d-a094-156092d44fed tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:20.891824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79c33149-046e-450d-a094-156092d44fed tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.892255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79c33149-046e-450d-a094-156092d44fed tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.893033 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79c33149-046e-450d-a094-156092d44fed tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.893684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-79c33149-046e-450d-a094-156092d44fed tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.924127 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-7e94f516-a449-42c0-b384-ca036fed6826 req-edb46e2e-a4f1-48c3-b979-bcce13e38855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef06b3f7-244b-42fd-8657-59708a3b66f5", "name": "network-vif-deleted", "tag": "3b0d0eff-4509-4ba8-a8f0-305d4896d23f"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:20.932312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-7e94f516-a449-42c0-b384-ca036fed6826 req-edb46e2e-a4f1-48c3-b979-bcce13e38855 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:20.932763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-7e94f516-a449-42c0-b384-ca036fed6826 req-edb46e2e-a4f1-48c3-b979-bcce13e38855 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:20.945060 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-7e94f516-a449-42c0-b384-ca036fed6826 req-edb46e2e-a4f1-48c3-b979-bcce13e38855 service nova] Creating event network-vif-deleted:3b0d0eff-4509-4ba8-a8f0-305d4896d23f for instance ef06b3f7-244b-42fd-8657-59708a3b66f5 on hv-cinder-78836 May 26 15:15:20.951018 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-7e94f516-a449-42c0-b384-ca036fed6826 req-edb46e2e-a4f1-48c3-b979-bcce13e38855 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029662 May 26 15:15:20.951766 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 426/867] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:21.056275 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-79c33149-046e-450d-a094-156092d44fed tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:21.064631 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-79c33149-046e-450d-a094-156092d44fed tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.189026 May 26 15:15:21.065067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 442/868] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:20 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:21.502594 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:21.503305 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:21.510772 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.511109 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.511859 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.512297 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.644256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:21.652872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:21.655002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:21.656398 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-bdbd9067-d9bf-41b0-8c34-5ed135a9f138 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.157948 May 26 15:15:21.657108 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 427/869] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:21 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:15:21.720821 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:21.721432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:21.727988 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.728467 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.729236 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.729703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.761995 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:21.762452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:21.762952 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lazy-loading 'fault' on Instance uuid ef06b3f7-244b-42fd-8657-59708a3b66f5 {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:21.809003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:21.816852 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ed39665e-1a54-4053-b9a2-27d0a05e4b20 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1311 microversion: 2.1 time: 0.099956 May 26 15:15:21.817419 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 443/870] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:21 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:22.081376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8056004f-fc55-4665-b737-45dc5a77f23c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:22.082029 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8056004f-fc55-4665-b737-45dc5a77f23c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:22.088506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8056004f-fc55-4665-b737-45dc5a77f23c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.088956 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8056004f-fc55-4665-b737-45dc5a77f23c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.089783 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8056004f-fc55-4665-b737-45dc5a77f23c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.090203 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8056004f-fc55-4665-b737-45dc5a77f23c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.231216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8056004f-fc55-4665-b737-45dc5a77f23c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:22.238935 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8056004f-fc55-4665-b737-45dc5a77f23c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.161450 May 26 15:15:22.239506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 428/871] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:22 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:22.675298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:22.675918 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:22.682133 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.682588 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.683363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.683806 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.821823 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:22.833105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:22.834626 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:22.835124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:22.835389 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:22.836389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d87aaf1b-01d4-4d4b-b035-3da7fbb5bcc2 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1729 microversion: 2.20 time: 0.165034 May 26 15:15:22.837832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 444/872] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:22 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:22.844692 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.845303 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.846223 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.846736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.882456 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:22.882908 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:22.883357 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lazy-loading 'fault' on Instance uuid ef06b3f7-244b-42fd-8657-59708a3b66f5 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:22.928452 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27172e53a12a437c9d57a75a95727d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e3fe61cc704411ac645e5935b9d258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:22.936735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-11cc3ee0-655f-44c3-9c0e-11b6bfe7ef86 tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 200 len: 1311 microversion: 2.1 time: 0.106730 May 26 15:15:22.937325 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 429/873] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:22 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:23.259096 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-37ce3685-6ace-42b8-b172-b10f0bae7b38 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:23.259713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-37ce3685-6ace-42b8-b172-b10f0bae7b38 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:23.266002 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-37ce3685-6ace-42b8-b172-b10f0bae7b38 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:23.266453 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-37ce3685-6ace-42b8-b172-b10f0bae7b38 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:23.267221 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-37ce3685-6ace-42b8-b172-b10f0bae7b38 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:23.267690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-37ce3685-6ace-42b8-b172-b10f0bae7b38 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:23.399392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-37ce3685-6ace-42b8-b172-b10f0bae7b38 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:23.402901 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:23.408837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-37ce3685-6ace-42b8-b172-b10f0bae7b38 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.155378 May 26 15:15:23.409397 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 445/874] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:23 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:23.855167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:23.855702 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:23.862472 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:23.862928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:23.863709 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:23.864149 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:23.953749 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:23.954395 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] [instance: ef06b3f7-244b-42fd-8657-59708a3b66f5] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:23.961082 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:23.961567 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:23.962337 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:23.962782 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:23.976350 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] HTTP exception thrown: Instance ef06b3f7-244b-42fd-8657-59708a3b66f5 could not be found. May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Request method failure captured: May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 HTTP/1.1 May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5hRvwCh_0EjDjPJrKGPN-nNnnn3ra8nC-wiV8Z3ZLol3S-_v1z_BoI1WppEzWWOsw2KXu-v_YyNZ8AZKmicfOwsWNz89ANHmuHTiYJbSDuKqzhbIZKw2QZmRDOpCH9qB6dPcgVEuqPBsWBqUu-lMOyym4jaYon5YIfCwIEe5Ro_pMw May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:23.978078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/45e3fe61cc704411ac645e5935b9d258"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_45e3fe61cc704411ac645e5935b9d258", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/45e3fe61cc704411ac645e5935b9d258"}]}] May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 45e3fe61cc704411ac645e5935b9d258 May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1909184515 May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 27172e53a12a437c9d57a75a95727d71 May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1909184515-project May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance ef06b3f7-244b-42fd-8657-59708a3b66f5 could not be found. May 26 15:15:23.979388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': 'ef06b3f7-244b-42fd-8657-59708a3b66f5'} May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef06b3f7-244b-42fd-8657-59708a3b66f5 could not be found. May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:23.980106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef06b3f7-244b-42fd-8657-59708a3b66f5 could not be found. May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef06b3f7-244b-42fd-8657-59708a3b66f5 could not be found. May 26 15:15:23.981321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:23.982449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] Returning 404 to user: Instance ef06b3f7-244b-42fd-8657-59708a3b66f5 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:23.982449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3100726f-4dcd-4746-9803-cee1fa20f41a tempest-ServerRescueNegativeTestJSON-1909184515 tempest-ServerRescueNegativeTestJSON-1909184515-project] 10.222.0.46 "GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5" status: 404 len: 111 microversion: 2.1 time: 0.030205 May 26 15:15:23.982449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 446/875] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:23 2022] GET /compute/v2.1/servers/ef06b3f7-244b-42fd-8657-59708a3b66f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:15:23.995532 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:24.007215 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:24.008577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:24.009782 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a23b9794-d7e6-4695-8971-916d80048d36 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1716 microversion: 2.20 time: 0.158635 May 26 15:15:24.010350 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 430/876] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:15:23 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:15:24.192550 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f3e23ffd-02e4-4d3b-be12-fdf8a65d45b4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:24.193802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f3e23ffd-02e4-4d3b-be12-fdf8a65d45b4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:24.199788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f3e23ffd-02e4-4d3b-be12-fdf8a65d45b4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:24.200242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f3e23ffd-02e4-4d3b-be12-fdf8a65d45b4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:24.201008 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f3e23ffd-02e4-4d3b-be12-fdf8a65d45b4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:24.201470 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f3e23ffd-02e4-4d3b-be12-fdf8a65d45b4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:24.229994 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f3e23ffd-02e4-4d3b-be12-fdf8a65d45b4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041266 May 26 15:15:24.230563 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 447/877] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:15:24 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:24.243304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1a581e2d-4c77-4601-b947-14f1ae1a7364 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:24.243800 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1a581e2d-4c77-4601-b947-14f1ae1a7364 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:24.250316 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a581e2d-4c77-4601-b947-14f1ae1a7364 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:24.250768 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a581e2d-4c77-4601-b947-14f1ae1a7364 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:24.251646 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a581e2d-4c77-4601-b947-14f1ae1a7364 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:24.252109 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1a581e2d-4c77-4601-b947-14f1ae1a7364 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:24.280065 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1a581e2d-4c77-4601-b947-14f1ae1a7364 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/6b05eac4-4e9f-4c7c-b187-43bd0ad2551d" status: 200 len: 194 microversion: 2.1 time: 0.041440 May 26 15:15:24.280650 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 431/878] 10.222.0.46 () {58 vars in 1412 bytes} [Thu May 26 15:15:24 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/6b05eac4-4e9f-4c7c-b187-43bd0ad2551d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:24.429150 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-85e417b0-6253-48f6-955f-94b2f032c2eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:24.431545 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-85e417b0-6253-48f6-955f-94b2f032c2eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:24.439608 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-85e417b0-6253-48f6-955f-94b2f032c2eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:24.440060 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-85e417b0-6253-48f6-955f-94b2f032c2eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:24.440849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-85e417b0-6253-48f6-955f-94b2f032c2eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:24.441296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-85e417b0-6253-48f6-955f-94b2f032c2eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:24.636666 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-85e417b0-6253-48f6-955f-94b2f032c2eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:24.644370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-85e417b0-6253-48f6-955f-94b2f032c2eb tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.221222 May 26 15:15:24.645009 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 448/879] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:24 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:25.659813 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1923640c-9c91-45f1-b010-7ef2983487e4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca0827ae-079b-4773-bdb3-a79911d6231d"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:25.661248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1923640c-9c91-45f1-b010-7ef2983487e4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:25.663979 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b86af4d9-1b33-461c-901c-48179ea5d324 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:25.664716 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b86af4d9-1b33-461c-901c-48179ea5d324 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:25.668391 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:25.670381 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1923640c-9c91-45f1-b010-7ef2983487e4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:25.670847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1923640c-9c91-45f1-b010-7ef2983487e4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:25.671806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1923640c-9c91-45f1-b010-7ef2983487e4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:25.672257 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1923640c-9c91-45f1-b010-7ef2983487e4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:25.676266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b86af4d9-1b33-461c-901c-48179ea5d324 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:25.677064 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b86af4d9-1b33-461c-901c-48179ea5d324 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:25.678041 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b86af4d9-1b33-461c-901c-48179ea5d324 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:25.679696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b86af4d9-1b33-461c-901c-48179ea5d324 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:25.985011 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1923640c-9c91-45f1-b010-7ef2983487e4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "POST /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334453 May 26 15:15:25.986158 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 432/880] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:15:25 2022] POST /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:26.192288 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b86af4d9-1b33-461c-901c-48179ea5d324 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:26.205763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b86af4d9-1b33-461c-901c-48179ea5d324 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.544872 May 26 15:15:26.206941 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 449/881] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:25 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:27.229584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-027521f3-d6db-416a-8f6d-3c5499af31e7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:27.229584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-027521f3-d6db-416a-8f6d-3c5499af31e7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:27.237090 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-027521f3-d6db-416a-8f6d-3c5499af31e7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:27.237606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-027521f3-d6db-416a-8f6d-3c5499af31e7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:27.238498 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-027521f3-d6db-416a-8f6d-3c5499af31e7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:27.238839 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-027521f3-d6db-416a-8f6d-3c5499af31e7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:27.440184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-027521f3-d6db-416a-8f6d-3c5499af31e7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:27.452838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-027521f3-d6db-416a-8f6d-3c5499af31e7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.232379 May 26 15:15:27.454618 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 433/882] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:27 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:28.473317 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ecf386d6-5cd9-412f-a7c6-4d425e582509 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:28.474865 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ecf386d6-5cd9-412f-a7c6-4d425e582509 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:28.482088 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ecf386d6-5cd9-412f-a7c6-4d425e582509 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:28.482562 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ecf386d6-5cd9-412f-a7c6-4d425e582509 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:28.484997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ecf386d6-5cd9-412f-a7c6-4d425e582509 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:28.484997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ecf386d6-5cd9-412f-a7c6-4d425e582509 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:28.641969 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ecf386d6-5cd9-412f-a7c6-4d425e582509 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:28.650365 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ecf386d6-5cd9-412f-a7c6-4d425e582509 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.182647 May 26 15:15:28.650952 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 450/883] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:28 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:29.669148 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-23690365-28d8-4219-b75b-7d607656a45a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:29.670027 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-23690365-28d8-4219-b75b-7d607656a45a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:29.679005 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-23690365-28d8-4219-b75b-7d607656a45a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:29.679456 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-23690365-28d8-4219-b75b-7d607656a45a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:29.680240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-23690365-28d8-4219-b75b-7d607656a45a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:29.680670 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-23690365-28d8-4219-b75b-7d607656a45a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:29.837070 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-23690365-28d8-4219-b75b-7d607656a45a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:29.853279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-23690365-28d8-4219-b75b-7d607656a45a tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.187656 May 26 15:15:29.862968 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 434/884] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:29 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:30.872209 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-4a0cedbb-48f2-45f5-916e-c96a0260135e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:30.872967 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-4a0cedbb-48f2-45f5-916e-c96a0260135e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:30.879792 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a0cedbb-48f2-45f5-916e-c96a0260135e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:30.880239 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a0cedbb-48f2-45f5-916e-c96a0260135e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:30.880999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a0cedbb-48f2-45f5-916e-c96a0260135e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:30.881478 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-4a0cedbb-48f2-45f5-916e-c96a0260135e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:31.030819 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-4a0cedbb-48f2-45f5-916e-c96a0260135e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:31.039139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-4a0cedbb-48f2-45f5-916e-c96a0260135e tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.171082 May 26 15:15:31.039725 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 451/885] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:30 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:32.056784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7ff6535a-969d-44dc-86d1-aedf3bf4dca5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:32.057381 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7ff6535a-969d-44dc-86d1-aedf3bf4dca5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:32.064899 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ff6535a-969d-44dc-86d1-aedf3bf4dca5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:32.065343 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ff6535a-969d-44dc-86d1-aedf3bf4dca5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:32.066632 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ff6535a-969d-44dc-86d1-aedf3bf4dca5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:32.067065 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7ff6535a-969d-44dc-86d1-aedf3bf4dca5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:32.208904 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7ff6535a-969d-44dc-86d1-aedf3bf4dca5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:32.217520 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7ff6535a-969d-44dc-86d1-aedf3bf4dca5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.164433 May 26 15:15:32.218114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 435/886] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:32 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:33.237497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6e6dda28-db41-4dd7-bd6e-64fd08488354 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:33.238175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6e6dda28-db41-4dd7-bd6e-64fd08488354 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:33.245356 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e6dda28-db41-4dd7-bd6e-64fd08488354 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.245838 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e6dda28-db41-4dd7-bd6e-64fd08488354 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.247250 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e6dda28-db41-4dd7-bd6e-64fd08488354 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.247720 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6e6dda28-db41-4dd7-bd6e-64fd08488354 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.397241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6e6dda28-db41-4dd7-bd6e-64fd08488354 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:33.405496 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6e6dda28-db41-4dd7-bd6e-64fd08488354 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.172411 May 26 15:15:33.406087 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 452/887] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:33 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:33.625920 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-df990373-8c52-442d-aa59-9a3531f47c2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:33.627047 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-df990373-8c52-442d-aa59-9a3531f47c2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:33.633763 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-df990373-8c52-442d-aa59-9a3531f47c2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.634303 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-df990373-8c52-442d-aa59-9a3531f47c2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.643311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-df990373-8c52-442d-aa59-9a3531f47c2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.644009 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-df990373-8c52-442d-aa59-9a3531f47c2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.680616 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-df990373-8c52-442d-aa59-9a3531f47c2d tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060360 May 26 15:15:33.681116 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 436/888] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:15:33 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:33.829352 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b731c8db-e249-4a9c-985b-7ff1efca9567 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:33.829352 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b731c8db-e249-4a9c-985b-7ff1efca9567 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:33.839764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b731c8db-e249-4a9c-985b-7ff1efca9567 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.840747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b731c8db-e249-4a9c-985b-7ff1efca9567 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.841567 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b731c8db-e249-4a9c-985b-7ff1efca9567 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.842014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b731c8db-e249-4a9c-985b-7ff1efca9567 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.880493 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b731c8db-e249-4a9c-985b-7ff1efca9567 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/6b05eac4-4e9f-4c7c-b187-43bd0ad2551d" status: 200 len: 194 microversion: 2.1 time: 0.056228 May 26 15:15:33.881186 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 453/889] 10.222.0.46 () {58 vars in 1412 bytes} [Thu May 26 15:15:33 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/6b05eac4-4e9f-4c7c-b187-43bd0ad2551d => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:33.892052 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-45006390-d357-4c41-b27f-a56ae55275fe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:33.892807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-45006390-d357-4c41-b27f-a56ae55275fe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:33.899392 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45006390-d357-4c41-b27f-a56ae55275fe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.899855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45006390-d357-4c41-b27f-a56ae55275fe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:33.900644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45006390-d357-4c41-b27f-a56ae55275fe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:33.901210 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-45006390-d357-4c41-b27f-a56ae55275fe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:34.012745 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-45006390-d357-4c41-b27f-a56ae55275fe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lazy-loading 'services' on Instance uuid d3b5c917-96e8-4255-8694-9f5e2c576bf8 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:34.111903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-45006390-d357-4c41-b27f-a56ae55275fe tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/6b05eac4-4e9f-4c7c-b187-43bd0ad2551d" status: 202 len: 0 microversion: 2.1 time: 0.223506 May 26 15:15:34.112935 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 437/890] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:15:33 2022] DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/6b05eac4-4e9f-4c7c-b187-43bd0ad2551d => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:34.424641 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2e21d860-df42-4c49-8ee5-e757076c30cf tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:34.425424 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2e21d860-df42-4c49-8ee5-e757076c30cf tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:34.432531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2e21d860-df42-4c49-8ee5-e757076c30cf tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:34.433138 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2e21d860-df42-4c49-8ee5-e757076c30cf tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:34.434162 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2e21d860-df42-4c49-8ee5-e757076c30cf tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:34.434680 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2e21d860-df42-4c49-8ee5-e757076c30cf tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:34.604593 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2e21d860-df42-4c49-8ee5-e757076c30cf tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:34.613870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2e21d860-df42-4c49-8ee5-e757076c30cf tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.193276 May 26 15:15:34.614465 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 454/891] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:34 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:35.636474 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-558705a1-a979-4f93-9bb4-6642691a2134 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:35.637368 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-558705a1-a979-4f93-9bb4-6642691a2134 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:35.644747 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-558705a1-a979-4f93-9bb4-6642691a2134 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.645550 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-558705a1-a979-4f93-9bb4-6642691a2134 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.646768 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-558705a1-a979-4f93-9bb4-6642691a2134 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:35.647177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-558705a1-a979-4f93-9bb4-6642691a2134 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:35.812402 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-558705a1-a979-4f93-9bb4-6642691a2134 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:35.816098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:35.820970 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-558705a1-a979-4f93-9bb4-6642691a2134 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.190293 May 26 15:15:35.821637 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 438/892] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:35 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:36.343201 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fd049f8c-1256-4678-a3af-78566ec85b12 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:36.343992 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fd049f8c-1256-4678-a3af-78566ec85b12 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:36.350071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd049f8c-1256-4678-a3af-78566ec85b12 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.350528 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd049f8c-1256-4678-a3af-78566ec85b12 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.351321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd049f8c-1256-4678-a3af-78566ec85b12 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.351796 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fd049f8c-1256-4678-a3af-78566ec85b12 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.381118 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fd049f8c-1256-4678-a3af-78566ec85b12 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/ca0827ae-079b-4773-bdb3-a79911d6231d" status: 200 len: 194 microversion: 2.1 time: 0.045851 May 26 15:15:36.381742 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 455/893] 10.222.0.46 () {58 vars in 1412 bytes} [Thu May 26 15:15:36 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/ca0827ae-079b-4773-bdb3-a79911d6231d => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:36.392435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-48021ded-8c62-4032-bd09-1623d64f092f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:36.392940 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-48021ded-8c62-4032-bd09-1623d64f092f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:36.400131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-48021ded-8c62-4032-bd09-1623d64f092f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.400591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-48021ded-8c62-4032-bd09-1623d64f092f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.401358 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-48021ded-8c62-4032-bd09-1623d64f092f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.401828 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-48021ded-8c62-4032-bd09-1623d64f092f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.457732 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-929f1000-f3f2-4df9-a013-c8f1c9e7c655 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:36.458503 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-929f1000-f3f2-4df9-a013-c8f1c9e7c655 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:36.464751 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-929f1000-f3f2-4df9-a013-c8f1c9e7c655 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.465931 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-929f1000-f3f2-4df9-a013-c8f1c9e7c655 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.466887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-929f1000-f3f2-4df9-a013-c8f1c9e7c655 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.467724 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-929f1000-f3f2-4df9-a013-c8f1c9e7c655 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.499308 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-929f1000-f3f2-4df9-a013-c8f1c9e7c655 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/ips" status: 200 len: 151 microversion: 2.1 time: 0.045438 May 26 15:15:36.499530 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-48021ded-8c62-4032-bd09-1623d64f092f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lazy-loading 'services' on Instance uuid d3b5c917-96e8-4255-8694-9f5e2c576bf8 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:36.499958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 456/894] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:15:36 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:15:36.593379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-48021ded-8c62-4032-bd09-1623d64f092f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/ca0827ae-079b-4773-bdb3-a79911d6231d" status: 202 len: 0 microversion: 2.1 time: 0.204962 May 26 15:15:36.594038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 439/895] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:15:36 2022] DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments/ca0827ae-079b-4773-bdb3-a79911d6231d => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:36.845245 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9b4c4b51-7717-4fc0-a6f8-8922c70ce80b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:36.847284 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9b4c4b51-7717-4fc0-a6f8-8922c70ce80b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:36.859991 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9b4c4b51-7717-4fc0-a6f8-8922c70ce80b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.860628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9b4c4b51-7717-4fc0-a6f8-8922c70ce80b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:36.861570 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9b4c4b51-7717-4fc0-a6f8-8922c70ce80b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:36.862014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9b4c4b51-7717-4fc0-a6f8-8922c70ce80b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.031748 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9b4c4b51-7717-4fc0-a6f8-8922c70ce80b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:37.040186 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9b4c4b51-7717-4fc0-a6f8-8922c70ce80b tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.204206 May 26 15:15:37.040757 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 457/896] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:36 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:37.903188 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4fa58fc3-be29-4a7d-9cf1-c18315b51979 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71d1028b-b948-403d-b9e2-0f359e743cb0"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:37.904637 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4fa58fc3-be29-4a7d-9cf1-c18315b51979 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:37.911240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4fa58fc3-be29-4a7d-9cf1-c18315b51979 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.911678 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4fa58fc3-be29-4a7d-9cf1-c18315b51979 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:37.914542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4fa58fc3-be29-4a7d-9cf1-c18315b51979 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:37.914542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4fa58fc3-be29-4a7d-9cf1-c18315b51979 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.059165 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-70a1a727-96fc-4677-bae5-caa0878c6c47 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:38.060283 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-70a1a727-96fc-4677-bae5-caa0878c6c47 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:38.068198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70a1a727-96fc-4677-bae5-caa0878c6c47 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.068658 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70a1a727-96fc-4677-bae5-caa0878c6c47 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.069443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70a1a727-96fc-4677-bae5-caa0878c6c47 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.069908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-70a1a727-96fc-4677-bae5-caa0878c6c47 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.273431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-70a1a727-96fc-4677-bae5-caa0878c6c47 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:38.283351 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-70a1a727-96fc-4677-bae5-caa0878c6c47 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.228265 May 26 15:15:38.283928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 458/897] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:38 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:38.379058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4fa58fc3-be29-4a7d-9cf1-c18315b51979 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "POST /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482770 May 26 15:15:38.379683 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 440/898] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:15:37 2022] POST /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:38.853974 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b7e2ed9b-31f0-43f5-8edb-c2842491462c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:38.855489 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b7e2ed9b-31f0-43f5-8edb-c2842491462c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:38.861144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7e2ed9b-31f0-43f5-8edb-c2842491462c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.861641 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7e2ed9b-31f0-43f5-8edb-c2842491462c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.862578 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7e2ed9b-31f0-43f5-8edb-c2842491462c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:38.862958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b7e2ed9b-31f0-43f5-8edb-c2842491462c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:38.897320 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b7e2ed9b-31f0-43f5-8edb-c2842491462c tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047382 May 26 15:15:38.897836 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 459/899] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:15:38 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 15:15:39.006597 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-555a72ca-05b2-4245-b869-de055f91c920 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:39.007673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-555a72ca-05b2-4245-b869-de055f91c920 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:39.014892 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-555a72ca-05b2-4245-b869-de055f91c920 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.015414 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-555a72ca-05b2-4245-b869-de055f91c920 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.016218 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-555a72ca-05b2-4245-b869-de055f91c920 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.016675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-555a72ca-05b2-4245-b869-de055f91c920 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.048835 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-555a72ca-05b2-4245-b869-de055f91c920 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048027 May 26 15:15:39.049549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 441/900] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:15:38 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:15:39.108318 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8739c209-9729-4a98-af59-705d0ca38c7f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:39.109046 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8739c209-9729-4a98-af59-705d0ca38c7f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:39.115829 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8739c209-9729-4a98-af59-705d0ca38c7f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.116289 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8739c209-9729-4a98-af59-705d0ca38c7f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.117078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8739c209-9729-4a98-af59-705d0ca38c7f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.117827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8739c209-9729-4a98-af59-705d0ca38c7f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.147699 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8739c209-9729-4a98-af59-705d0ca38c7f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:15:39.231856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8739c209-9729-4a98-af59-705d0ca38c7f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 204 len: 0 microversion: 2.1 time: 0.127179 May 26 15:15:39.232532 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 460/901] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:39 2022] DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:39.241014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3ea9523b-116e-44d3-ba75-46721be4930b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:39.241678 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3ea9523b-116e-44d3-ba75-46721be4930b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:39.249342 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3ea9523b-116e-44d3-ba75-46721be4930b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.249831 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3ea9523b-116e-44d3-ba75-46721be4930b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.250609 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3ea9523b-116e-44d3-ba75-46721be4930b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.251058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3ea9523b-116e-44d3-ba75-46721be4930b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.302591 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-731ade6f-da6d-4ff0-99b6-a196258a15b3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:39.303302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-731ade6f-da6d-4ff0-99b6-a196258a15b3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:39.315411 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-731ade6f-da6d-4ff0-99b6-a196258a15b3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.317681 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-731ade6f-da6d-4ff0-99b6-a196258a15b3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.318503 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-731ade6f-da6d-4ff0-99b6-a196258a15b3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.319123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-731ade6f-da6d-4ff0-99b6-a196258a15b3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.469940 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3ea9523b-116e-44d3-ba75-46721be4930b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:39.478342 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3ea9523b-116e-44d3-ba75-46721be4930b tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1674 microversion: 2.1 time: 0.241341 May 26 15:15:39.479059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 442/902] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:39 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1674 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:39.510794 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-731ade6f-da6d-4ff0-99b6-a196258a15b3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:39.514512 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:39.519580 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-731ade6f-da6d-4ff0-99b6-a196258a15b3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1509 microversion: 2.1 time: 0.221247 May 26 15:15:39.520154 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 461/903] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:39 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:39.537241 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5d2beaac-7fb8-4465-ac6a-35a16ea14d7f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:39.537952 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5d2beaac-7fb8-4465-ac6a-35a16ea14d7f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:39.545366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d2beaac-7fb8-4465-ac6a-35a16ea14d7f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.545859 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d2beaac-7fb8-4465-ac6a-35a16ea14d7f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.546909 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d2beaac-7fb8-4465-ac6a-35a16ea14d7f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.547505 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d2beaac-7fb8-4465-ac6a-35a16ea14d7f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.631448 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5d2beaac-7fb8-4465-ac6a-35a16ea14d7f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "POST /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae/action" status: 202 len: 0 microversion: 2.1 time: 0.098590 May 26 15:15:39.631971 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 443/904] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:15:39 2022] POST /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:39.640128 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7f5d0011-3d1e-43a0-bfd1-3d9dc1651b29 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:39.641106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7f5d0011-3d1e-43a0-bfd1-3d9dc1651b29 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:39.648676 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7f5d0011-3d1e-43a0-bfd1-3d9dc1651b29 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.649135 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7f5d0011-3d1e-43a0-bfd1-3d9dc1651b29 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.649947 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7f5d0011-3d1e-43a0-bfd1-3d9dc1651b29 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:39.650389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7f5d0011-3d1e-43a0-bfd1-3d9dc1651b29 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:39.795332 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7f5d0011-3d1e-43a0-bfd1-3d9dc1651b29 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:39.803125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7f5d0011-3d1e-43a0-bfd1-3d9dc1651b29 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1517 microversion: 2.1 time: 0.166719 May 26 15:15:39.803942 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 462/905] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:39 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:40.500070 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-99f9e838-82c1-4884-8ca2-e263a0e56270 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:40.500682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-99f9e838-82c1-4884-8ca2-e263a0e56270 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:40.508270 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-99f9e838-82c1-4884-8ca2-e263a0e56270 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:40.508719 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-99f9e838-82c1-4884-8ca2-e263a0e56270 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:40.509803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-99f9e838-82c1-4884-8ca2-e263a0e56270 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:40.510249 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-99f9e838-82c1-4884-8ca2-e263a0e56270 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:40.648448 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-99f9e838-82c1-4884-8ca2-e263a0e56270 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:40.656980 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-99f9e838-82c1-4884-8ca2-e263a0e56270 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1674 microversion: 2.1 time: 0.161450 May 26 15:15:40.657599 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 444/906] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:40 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:40.821053 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b462fc89-43ea-41ab-a8e3-d8e42c03c871 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:40.821630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b462fc89-43ea-41ab-a8e3-d8e42c03c871 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:40.828731 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b462fc89-43ea-41ab-a8e3-d8e42c03c871 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:40.829180 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b462fc89-43ea-41ab-a8e3-d8e42c03c871 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:40.829973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b462fc89-43ea-41ab-a8e3-d8e42c03c871 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:40.830413 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b462fc89-43ea-41ab-a8e3-d8e42c03c871 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:40.968659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b462fc89-43ea-41ab-a8e3-d8e42c03c871 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:40.977343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b462fc89-43ea-41ab-a8e3-d8e42c03c871 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1517 microversion: 2.1 time: 0.159940 May 26 15:15:40.978034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 463/907] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:40 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:41.675428 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-cc4ea7d9-11ae-4f58-87ce-3324cb43af33 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:41.676084 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-cc4ea7d9-11ae-4f58-87ce-3324cb43af33 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:41.682777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cc4ea7d9-11ae-4f58-87ce-3324cb43af33 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:41.683255 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cc4ea7d9-11ae-4f58-87ce-3324cb43af33 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:41.685115 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cc4ea7d9-11ae-4f58-87ce-3324cb43af33 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:41.685583 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-cc4ea7d9-11ae-4f58-87ce-3324cb43af33 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:41.769496 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-751fbb6d-68cd-4967-b645-8f246898ac20 req-d9df40ab-4702-4ebf-802c-8b9528b9b4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a80f2c7-1451-47b7-9f5e-3d53c21794ae", "name": "network-vif-unplugged", "status": "completed", "tag": "919581af-7ccb-4d91-b17b-36af6ce1ee96"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:41.779220 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-751fbb6d-68cd-4967-b645-8f246898ac20 req-d9df40ab-4702-4ebf-802c-8b9528b9b4a6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:41.780024 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-751fbb6d-68cd-4967-b645-8f246898ac20 req-d9df40ab-4702-4ebf-802c-8b9528b9b4a6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:41.799948 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.compute.server_external_events [req-751fbb6d-68cd-4967-b645-8f246898ac20 req-d9df40ab-4702-4ebf-802c-8b9528b9b4a6 service nova] Unable to find a host for instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae. Dropping event network-vif-unplugged {{(pid=117723) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 15:15:41.801621 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-751fbb6d-68cd-4967-b645-8f246898ac20 req-d9df40ab-4702-4ebf-802c-8b9528b9b4a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035545 May 26 15:15:41.802673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 464/908] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 26 15:15:41.832010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-cc4ea7d9-11ae-4f58-87ce-3324cb43af33 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:41.848257 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-cc4ea7d9-11ae-4f58-87ce-3324cb43af33 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1674 microversion: 2.1 time: 0.177287 May 26 15:15:41.848934 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 445/909] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:41 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:41.995292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7e8118b9-bfe5-44ac-aa48-02364d908ac3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:41.996123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7e8118b9-bfe5-44ac-aa48-02364d908ac3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:42.003638 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7e8118b9-bfe5-44ac-aa48-02364d908ac3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:42.004532 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7e8118b9-bfe5-44ac-aa48-02364d908ac3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:42.005327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7e8118b9-bfe5-44ac-aa48-02364d908ac3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:42.006047 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7e8118b9-bfe5-44ac-aa48-02364d908ac3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:42.273434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-7e8118b9-bfe5-44ac-aa48-02364d908ac3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:42.282092 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7e8118b9-bfe5-44ac-aa48-02364d908ac3 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1519 microversion: 2.1 time: 0.291064 May 26 15:15:42.283091 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 465/910] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:41 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1519 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:42.803831 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-49b3895c-4ea6-426a-823e-5651aef3b099 req-6c2ab921-5f2c-4527-8612-5c2fe2fa71c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b5c917-96e8-4255-8694-9f5e2c576bf8", "name": "network-vif-deleted", "tag": "f871e666-9660-4b15-9eb5-a7c607fa8094"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:42.814791 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-49b3895c-4ea6-426a-823e-5651aef3b099 req-6c2ab921-5f2c-4527-8612-5c2fe2fa71c8 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:42.815543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-49b3895c-4ea6-426a-823e-5651aef3b099 req-6c2ab921-5f2c-4527-8612-5c2fe2fa71c8 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:42.834015 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-49b3895c-4ea6-426a-823e-5651aef3b099 req-6c2ab921-5f2c-4527-8612-5c2fe2fa71c8 service nova] Creating event network-vif-deleted:f871e666-9660-4b15-9eb5-a7c607fa8094 for instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 on hv-cinder-78836 May 26 15:15:42.840644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-49b3895c-4ea6-426a-823e-5651aef3b099 req-6c2ab921-5f2c-4527-8612-5c2fe2fa71c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040339 May 26 15:15:42.843256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 446/911] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:42.879430 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-925646ca-b40d-4c7e-a081-ad4239a100d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:42.882016 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-925646ca-b40d-4c7e-a081-ad4239a100d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:42.903236 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-925646ca-b40d-4c7e-a081-ad4239a100d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:42.910340 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-925646ca-b40d-4c7e-a081-ad4239a100d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:42.911359 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-925646ca-b40d-4c7e-a081-ad4239a100d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:42.911816 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-925646ca-b40d-4c7e-a081-ad4239a100d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:42.985945 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b3b9baaf-ebb2-40e6-bee7-77ef3176fa1e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:42.986642 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b3b9baaf-ebb2-40e6-bee7-77ef3176fa1e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:43.001147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b3b9baaf-ebb2-40e6-bee7-77ef3176fa1e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.005868 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b3b9baaf-ebb2-40e6-bee7-77ef3176fa1e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.010046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b3b9baaf-ebb2-40e6-bee7-77ef3176fa1e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.010046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b3b9baaf-ebb2-40e6-bee7-77ef3176fa1e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.079327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-925646ca-b40d-4c7e-a081-ad4239a100d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e95b6425286f4235b9d1802acddac4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0910873988084bc0becc79bb99febc96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:43.087731 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-925646ca-b40d-4c7e-a081-ad4239a100d4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 200 len: 1323 microversion: 2.1 time: 0.219480 May 26 15:15:43.088633 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 466/912] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:42 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 1323 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:43.131899 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-b3b9baaf-ebb2-40e6-bee7-77ef3176fa1e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lazy-loading 'services' on Instance uuid 7271edca-3b23-4dc4-aa5e-728df4f00cfd {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:43.218150 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b3b9baaf-ebb2-40e6-bee7-77ef3176fa1e tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments/71d1028b-b948-403d-b9e2-0f359e743cb0" status: 202 len: 0 microversion: 2.1 time: 0.240332 May 26 15:15:43.219052 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 447/913] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:15:42 2022] DELETE /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments/71d1028b-b948-403d-b9e2-0f359e743cb0 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:43.230302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-856019b9-bdb7-4a9e-ae9d-7ab6d99172e2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:43.234577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-856019b9-bdb7-4a9e-ae9d-7ab6d99172e2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:43.243223 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-856019b9-bdb7-4a9e-ae9d-7ab6d99172e2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.243692 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-856019b9-bdb7-4a9e-ae9d-7ab6d99172e2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.244482 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-856019b9-bdb7-4a9e-ae9d-7ab6d99172e2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.244918 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-856019b9-bdb7-4a9e-ae9d-7ab6d99172e2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.276929 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-856019b9-bdb7-4a9e-ae9d-7ab6d99172e2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052574 May 26 15:15:43.281859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 467/914] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:15:43 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:43.302521 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-771cece4-5d60-4d64-a6ab-c07c153dcbc7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:43.303692 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-771cece4-5d60-4d64-a6ab-c07c153dcbc7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:43.311289 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-771cece4-5d60-4d64-a6ab-c07c153dcbc7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.311747 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-771cece4-5d60-4d64-a6ab-c07c153dcbc7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.312748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-771cece4-5d60-4d64-a6ab-c07c153dcbc7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:43.313194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-771cece4-5d60-4d64-a6ab-c07c153dcbc7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:43.468864 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-771cece4-5d60-4d64-a6ab-c07c153dcbc7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:43.487276 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-771cece4-5d60-4d64-a6ab-c07c153dcbc7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.188937 May 26 15:15:43.487933 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 448/915] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:43 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:44.106019 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:44.106856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:44.112920 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.113740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.114700 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.115308 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.132825 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] HTTP exception thrown: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Request method failure captured: May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 HTTP/1.1 May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gZVcOyO39b_xiNYQbkLarkzGT1otldshHhqmj-Snsh1fAjLhDiylhjLLvqHoi0moz_fHeDtqwqTgqJA2TJew1Ta4MWBqYwGp5jI2NrYWNAK2-NTmGnI8D8oo8C0a3Rah57eGqYqgiFkTcpOQ1Hs-KwBIAvh3-VpoVvn4HBv6s3CZs May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:44.134531 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0910873988084bc0becc79bb99febc96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0910873988084bc0becc79bb99febc96"}]}] May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: e95b6425286f4235b9d1802acddac4b8 May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:44.136226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': 'd3b5c917-96e8-4255-8694-9f5e2c576bf8'} May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:44.137639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:44.139102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:44.140514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Returning 404 to user: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:44.140514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-64fba9a7-de1a-4bc0-9493-bb50a4c0cbb4 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 404 len: 111 microversion: 2.1 time: 0.034967 May 26 15:15:44.140514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 468/916] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:44 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:44.145844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8b4d4737-7d3b-49ef-8ef1-21ccf447f296 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '.version_select at 0x7ff9656b0f70>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:44.172716 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8b4d4737-7d3b-49ef-8ef1-21ccf447f296 tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911996091" status: 202 len: 0 microversion: 2.1 time: 0.030758 May 26 15:15:44.173598 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 449/917] 10.222.0.46 () {58 vars in 1220 bytes} [Thu May 26 15:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911996091 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:44.290083 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6c8080e9-2289-4d23-b045-eb0e933318d2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:44.291038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6c8080e9-2289-4d23-b045-eb0e933318d2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:44.297795 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c8080e9-2289-4d23-b045-eb0e933318d2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.298520 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c8080e9-2289-4d23-b045-eb0e933318d2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.299562 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c8080e9-2289-4d23-b045-eb0e933318d2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.300007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c8080e9-2289-4d23-b045-eb0e933318d2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.334592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6c8080e9-2289-4d23-b045-eb0e933318d2 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048465 May 26 15:15:44.335855 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 469/918] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:15:44 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:44.506238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-614568c0-e6e4-4a84-91bb-82e6bb15d131 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:44.507321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-614568c0-e6e4-4a84-91bb-82e6bb15d131 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:44.514454 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-614568c0-e6e4-4a84-91bb-82e6bb15d131 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.514925 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-614568c0-e6e4-4a84-91bb-82e6bb15d131 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.515928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-614568c0-e6e4-4a84-91bb-82e6bb15d131 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:44.516372 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-614568c0-e6e4-4a84-91bb-82e6bb15d131 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:44.807514 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-614568c0-e6e4-4a84-91bb-82e6bb15d131 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:44.816930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-614568c0-e6e4-4a84-91bb-82e6bb15d131 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.316389 May 26 15:15:44.817890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 450/919] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:44 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:45.346039 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5697042b-9315-4f09-89bc-8ba10a817e1c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:45.346955 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5697042b-9315-4f09-89bc-8ba10a817e1c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:45.353830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5697042b-9315-4f09-89bc-8ba10a817e1c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.354277 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5697042b-9315-4f09-89bc-8ba10a817e1c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.355040 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5697042b-9315-4f09-89bc-8ba10a817e1c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.355975 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5697042b-9315-4f09-89bc-8ba10a817e1c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.392106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5697042b-9315-4f09-89bc-8ba10a817e1c tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050026 May 26 15:15:45.392798 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 470/920] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:15:45 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:15:45.470240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-25ecf9c0-196c-468a-b381-3fc440f41772 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:45.471042 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-25ecf9c0-196c-468a-b381-3fc440f41772 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:45.478341 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-25ecf9c0-196c-468a-b381-3fc440f41772 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.478865 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-25ecf9c0-196c-468a-b381-3fc440f41772 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.479800 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-25ecf9c0-196c-468a-b381-3fc440f41772 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.480846 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-25ecf9c0-196c-468a-b381-3fc440f41772 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.520274 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-25ecf9c0-196c-468a-b381-3fc440f41772 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:15:45.581654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:45.618424 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-25ecf9c0-196c-468a-b381-3fc440f41772 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 204 len: 0 microversion: 2.1 time: 0.152020 May 26 15:15:45.621542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 451/921] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:45 2022] DELETE /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:45.629360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2190e0dd-cf28-44c7-8fe4-f260a83669f3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:45.629542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2190e0dd-cf28-44c7-8fe4-f260a83669f3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:45.636152 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2190e0dd-cf28-44c7-8fe4-f260a83669f3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.636754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2190e0dd-cf28-44c7-8fe4-f260a83669f3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.637635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2190e0dd-cf28-44c7-8fe4-f260a83669f3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.638128 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2190e0dd-cf28-44c7-8fe4-f260a83669f3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.791728 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2190e0dd-cf28-44c7-8fe4-f260a83669f3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:45.800208 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2190e0dd-cf28-44c7-8fe4-f260a83669f3 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1683 microversion: 2.1 time: 0.176521 May 26 15:15:45.800777 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 471/922] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:45 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:45.838271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-08f833e9-0e1d-42a5-82eb-ee824b232426 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:45.838968 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-08f833e9-0e1d-42a5-82eb-ee824b232426 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:45.845571 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08f833e9-0e1d-42a5-82eb-ee824b232426 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.846010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08f833e9-0e1d-42a5-82eb-ee824b232426 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:45.846769 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08f833e9-0e1d-42a5-82eb-ee824b232426 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:45.847197 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-08f833e9-0e1d-42a5-82eb-ee824b232426 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:46.002735 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-08f833e9-0e1d-42a5-82eb-ee824b232426 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:46.011195 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-08f833e9-0e1d-42a5-82eb-ee824b232426 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.177071 May 26 15:15:46.012622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 452/923] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:45 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:46.821568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b29f1b1a-ff5c-4a68-a6a4-9e05cebee2e7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:46.822185 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b29f1b1a-ff5c-4a68-a6a4-9e05cebee2e7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:46.829791 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b29f1b1a-ff5c-4a68-a6a4-9e05cebee2e7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:46.830254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b29f1b1a-ff5c-4a68-a6a4-9e05cebee2e7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:46.831020 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b29f1b1a-ff5c-4a68-a6a4-9e05cebee2e7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:46.831456 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b29f1b1a-ff5c-4a68-a6a4-9e05cebee2e7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:46.965654 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b29f1b1a-ff5c-4a68-a6a4-9e05cebee2e7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:46.973191 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b29f1b1a-ff5c-4a68-a6a4-9e05cebee2e7 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1683 microversion: 2.1 time: 0.155915 May 26 15:15:46.973797 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 472/924] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:46 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:47.029937 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-89073473-bdba-4d6a-a6b8-bb6a3bd19de9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:47.030557 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-89073473-bdba-4d6a-a6b8-bb6a3bd19de9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:47.037328 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-89073473-bdba-4d6a-a6b8-bb6a3bd19de9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:47.037810 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-89073473-bdba-4d6a-a6b8-bb6a3bd19de9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:47.038583 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-89073473-bdba-4d6a-a6b8-bb6a3bd19de9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:47.039029 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-89073473-bdba-4d6a-a6b8-bb6a3bd19de9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:47.175586 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-89073473-bdba-4d6a-a6b8-bb6a3bd19de9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:47.184091 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-89073473-bdba-4d6a-a6b8-bb6a3bd19de9 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.157950 May 26 15:15:47.184677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 453/925] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:47 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:47.482399 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:47.482897 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:47.489055 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:47.489539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:47.490311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:47.490754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:47.505572 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] HTTP exception thrown: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Request method failure captured: May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 HTTP/1.1 May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gZVcOyO39b_xiNYQbkLarkzGT1otldshHhqmj-Snsh1fAjLhDiylhjLLvqHoi0moz_fHeDtqwqTgqJA2TJew1Ta4MWBqYwGp5jI2NrYWNAK2-NTmGnI8D8oo8C0a3Rah57eGqYqgiFkTcpOQ1Hs-KwBIAvh3-VpoVvn4HBv6s3CZs May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:47.507164 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0910873988084bc0becc79bb99febc96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0910873988084bc0becc79bb99febc96"}]}] May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: e95b6425286f4235b9d1802acddac4b8 May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.508803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': 'd3b5c917-96e8-4255-8694-9f5e2c576bf8'} May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:47.509688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.511111 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:47.512695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Returning 404 to user: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:47.512695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3591f3d7-d96a-4b11-a115-52ba948c639f tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 404 len: 111 microversion: 2.1 time: 0.030538 May 26 15:15:47.512695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 473/926] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:47 2022] DELETE /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:47.519135 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:47.519759 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: d3b5c917-96e8-4255-8694-9f5e2c576bf8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:47.521777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:47.531430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:47.531430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:47.531430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:47.531430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] HTTP exception thrown: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Request method failure captured: May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 HTTP/1.1 May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gZVcOyO39b_xiNYQbkLarkzGT1otldshHhqmj-Snsh1fAjLhDiylhjLLvqHoi0moz_fHeDtqwqTgqJA2TJew1Ta4MWBqYwGp5jI2NrYWNAK2-NTmGnI8D8oo8C0a3Rah57eGqYqgiFkTcpOQ1Hs-KwBIAvh3-VpoVvn4HBv6s3CZs May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:15:47.547376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0910873988084bc0becc79bb99febc96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0910873988084bc0becc79bb99febc96"}]}] May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: e95b6425286f4235b9d1802acddac4b8 May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.548997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': 'd3b5c917-96e8-4255-8694-9f5e2c576bf8'} May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:47.550717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. May 26 15:15:47.552058 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:47.553105 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Returning 404 to user: Instance d3b5c917-96e8-4255-8694-9f5e2c576bf8 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:47.553105 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-475c25ed-e0ad-42d3-8649-485f8ca36eaa tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8" status: 404 len: 111 microversion: 2.1 time: 0.033716 May 26 15:15:47.553105 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 454/927] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:47 2022] GET /compute/v2.1/servers/d3b5c917-96e8-4255-8694-9f5e2c576bf8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:47.991630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-169a857b-fce2-42a3-b68a-75d3616a094f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:47.992198 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-169a857b-fce2-42a3-b68a-75d3616a094f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:48.000797 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-169a857b-fce2-42a3-b68a-75d3616a094f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.001253 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-169a857b-fce2-42a3-b68a-75d3616a094f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.002070 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-169a857b-fce2-42a3-b68a-75d3616a094f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.002508 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-169a857b-fce2-42a3-b68a-75d3616a094f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.104763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-169a857b-fce2-42a3-b68a-75d3616a094f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:48.113155 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-169a857b-fce2-42a3-b68a-75d3616a094f tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1616 microversion: 2.1 time: 0.126162 May 26 15:15:48.113798 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 474/928] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:47 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1616 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:48.201559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-92f5e62e-c500-4a41-ba17-994a2b20fb53 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:48.202357 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-92f5e62e-c500-4a41-ba17-994a2b20fb53 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:48.209210 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92f5e62e-c500-4a41-ba17-994a2b20fb53 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.209701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92f5e62e-c500-4a41-ba17-994a2b20fb53 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.210522 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92f5e62e-c500-4a41-ba17-994a2b20fb53 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.211036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-92f5e62e-c500-4a41-ba17-994a2b20fb53 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.458127 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-92f5e62e-c500-4a41-ba17-994a2b20fb53 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:48.468665 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-92f5e62e-c500-4a41-ba17-994a2b20fb53 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.271542 May 26 15:15:48.469435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 455/929] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:48 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:48.488593 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-f17b572e-64f9-49e5-a82a-a78f873a474f req-d6612114-880e-472d-ba4e-9ce82f06a053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7271edca-3b23-4dc4-aa5e-728df4f00cfd", "name": "network-vif-deleted", "tag": "bc982787-f0cd-4e5d-9f77-626bef64840b"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:48.500285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f17b572e-64f9-49e5-a82a-a78f873a474f req-d6612114-880e-472d-ba4e-9ce82f06a053 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.501113 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-f17b572e-64f9-49e5-a82a-a78f873a474f req-d6612114-880e-472d-ba4e-9ce82f06a053 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.518096 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-f17b572e-64f9-49e5-a82a-a78f873a474f req-d6612114-880e-472d-ba4e-9ce82f06a053 service nova] Creating event network-vif-deleted:bc982787-f0cd-4e5d-9f77-626bef64840b for instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd on hv-cinder-78836 May 26 15:15:48.529009 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-f17b572e-64f9-49e5-a82a-a78f873a474f req-d6612114-880e-472d-ba4e-9ce82f06a053 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043397 May 26 15:15:48.530628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 475/930] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:48.738716 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:48.739752 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:48.751742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.752753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.754309 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.755157 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.787742 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] HTTP exception thrown: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Request method failure captured: May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: DELETE /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 HTTP/1.1 May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gZVcOyO39b_xiNYQbkLarkzGT1otldshHhqmj-Snsh1fAjLhDiylhjLLvqHoi0moz_fHeDtqwqTgqJA2TJew1Ta4MWBqYwGp5jI2NrYWNAK2-NTmGnI8D8oo8C0a3Rah57eGqYqgiFkTcpOQ1Hs-KwBIAvh3-VpoVvn4HBv6s3CZs May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:15:48.791131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0910873988084bc0becc79bb99febc96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0910873988084bc0becc79bb99febc96"}]}] May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: e95b6425286f4235b9d1802acddac4b8 May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.792872 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': 'dea4ff4a-0c29-465d-b388-d223fd508a69'} May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:48.794034 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.796279 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:48.798591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Returning 404 to user: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:48.798591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-11b813f0-bd1d-4fc8-b10f-b0f1d489bd0a tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 404 len: 111 microversion: 2.1 time: 0.061906 May 26 15:15:48.798591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 456/931] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:48 2022] DELETE /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:48.806864 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:48.807635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] [instance: dea4ff4a-0c29-465d-b388-d223fd508a69] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:48.815383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.816043 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.816830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:48.817267 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:48.837405 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] HTTP exception thrown: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Request method failure captured: May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 HTTP/1.1 May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gZVcOyO39b_xiNYQbkLarkzGT1otldshHhqmj-Snsh1fAjLhDiylhjLLvqHoi0moz_fHeDtqwqTgqJA2TJew1Ta4MWBqYwGp5jI2NrYWNAK2-NTmGnI8D8oo8C0a3Rah57eGqYqgiFkTcpOQ1Hs-KwBIAvh3-VpoVvn4HBv6s3CZs May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:48.839242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0910873988084bc0becc79bb99febc96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0910873988084bc0becc79bb99febc96", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0910873988084bc0becc79bb99febc96"}]}] May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 0910873988084bc0becc79bb99febc96 May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeTestJSON-133946326 May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: e95b6425286f4235b9d1802acddac4b8 May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeTestJSON-133946326-project May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.841279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': 'dea4ff4a-0c29-465d-b388-d223fd508a69'} May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:48.842999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. May 26 15:15:48.845784 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:48.848532 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] Returning 404 to user: Instance dea4ff4a-0c29-465d-b388-d223fd508a69 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:48.848532 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3db5cba2-91e9-4cbf-a8ce-db6c6db954af tempest-AttachVolumeTestJSON-133946326 tempest-AttachVolumeTestJSON-133946326-project] 10.222.0.46 "GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69" status: 404 len: 111 microversion: 2.1 time: 0.038628 May 26 15:15:48.848532 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 476/932] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:48 2022] GET /compute/v2.1/servers/dea4ff4a-0c29-465d-b388-d223fd508a69 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:49.132088 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:49.132965 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:49.140958 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.141775 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.142758 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.143349 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.215367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.217212 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.218114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lazy-loading 'fault' on Instance uuid 7271edca-3b23-4dc4-aa5e-728df4f00cfd {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:15:49.288124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ce5b5d5a12743bc80a4b191c24ff52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9780d0cae62c4f5088060b530571ebb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:49.298342 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e54a0cf6-1da9-450c-9a1b-fbe7d6b85bf5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 200 len: 1332 microversion: 2.1 time: 0.170597 May 26 15:15:49.299204 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 457/933] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:49 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 1332 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:49.495894 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f52f27d9-8605-44ea-9010-96bd1188181d tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:49.497421 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f52f27d9-8605-44ea-9010-96bd1188181d tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:49.506176 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f52f27d9-8605-44ea-9010-96bd1188181d tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.506804 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f52f27d9-8605-44ea-9010-96bd1188181d tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.508883 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f52f27d9-8605-44ea-9010-96bd1188181d tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:49.509548 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f52f27d9-8605-44ea-9010-96bd1188181d tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:49.668728 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f52f27d9-8605-44ea-9010-96bd1188181d tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:49.679508 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f52f27d9-8605-44ea-9010-96bd1188181d tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.188957 May 26 15:15:49.680262 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 477/934] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:49 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:50.318385 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:50.319253 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:50.328560 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:50.329017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:50.329852 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:50.330312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:50.344940 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd HTTP/1.1 May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:15:50.346654 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:50.348403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '7271edca-3b23-4dc4-aa5e-728df4f00cfd'} May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:50.349657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:50.351194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:50.352558 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:50.352558 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9cd580dc-8982-4ce4-ab52-fa96f3eddf19 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 404 len: 111 microversion: 2.1 time: 0.034012 May 26 15:15:50.352558 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 458/935] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:50 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:50.358612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-32fc8643-9314-4052-8565-e968a96bb91b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '.version_select at 0x7ff96699a1f0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:50.382195 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-32fc8643-9314-4052-8565-e968a96bb91b tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022567984" status: 202 len: 0 microversion: 2.1 time: 0.027665 May 26 15:15:50.383352 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 478/936] 10.222.0.46 () {58 vars in 1220 bytes} [Thu May 26 15:15:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022567984 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:50.696660 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5e9be5d6-4416-4d20-b7a9-2c8f8d3e18f5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:50.697312 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5e9be5d6-4416-4d20-b7a9-2c8f8d3e18f5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:50.707580 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5e9be5d6-4416-4d20-b7a9-2c8f8d3e18f5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:50.708315 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5e9be5d6-4416-4d20-b7a9-2c8f8d3e18f5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:50.709388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5e9be5d6-4416-4d20-b7a9-2c8f8d3e18f5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:50.710050 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5e9be5d6-4416-4d20-b7a9-2c8f8d3e18f5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:50.955024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5e9be5d6-4416-4d20-b7a9-2c8f8d3e18f5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:50.964112 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5e9be5d6-4416-4d20-b7a9-2c8f8d3e18f5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.271733 May 26 15:15:50.968953 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 459/937] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:50 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:51.989814 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0ed3bb19-34d6-4bb9-9ac8-12d3640e608c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:51.990876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0ed3bb19-34d6-4bb9-9ac8-12d3640e608c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:51.999144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0ed3bb19-34d6-4bb9-9ac8-12d3640e608c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:51.999635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0ed3bb19-34d6-4bb9-9ac8-12d3640e608c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.000406 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0ed3bb19-34d6-4bb9-9ac8-12d3640e608c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.000848 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0ed3bb19-34d6-4bb9-9ac8-12d3640e608c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.307437 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0ed3bb19-34d6-4bb9-9ac8-12d3640e608c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:52.323096 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0ed3bb19-34d6-4bb9-9ac8-12d3640e608c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.338370 May 26 15:15:52.329207 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 479/938] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:51 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:15:52.528306 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:52.528843 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:52.554966 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.555421 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.556227 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.556734 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.604703 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: DELETE /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd HTTP/1.1 May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:15:52.620147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.622263 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '7271edca-3b23-4dc4-aa5e-728df4f00cfd'} May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:52.623010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.624190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:52.631130 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:52.632424 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-399249a8-3933-4ee4-ab2d-c402cfc38ad5 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 404 len: 111 microversion: 2.1 time: 0.114035 May 26 15:15:52.633271 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 460/939] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:52 2022] DELETE /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:52.648464 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:52.649131 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 7271edca-3b23-4dc4-aa5e-728df4f00cfd] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:52.666973 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.668302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.669590 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:52.670228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:52.694064 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd HTTP/1.1 May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:52.695803 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.697115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '7271edca-3b23-4dc4-aa5e-728df4f00cfd'} May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:52.697987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. May 26 15:15:52.699268 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:52.700353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 7271edca-3b23-4dc4-aa5e-728df4f00cfd could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:52.700353 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-330ecd3c-221d-4db3-b462-2efffcdc4748 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd" status: 404 len: 111 microversion: 2.1 time: 0.057543 May 26 15:15:52.701781 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 480/940] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:52 2022] GET /compute/v2.1/servers/7271edca-3b23-4dc4-aa5e-728df4f00cfd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:53.346302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b1ba0079-ef4f-4370-8c5d-5a632759b261 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:53.347059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b1ba0079-ef4f-4370-8c5d-5a632759b261 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:53.353423 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b1ba0079-ef4f-4370-8c5d-5a632759b261 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.353961 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b1ba0079-ef4f-4370-8c5d-5a632759b261 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:53.354734 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b1ba0079-ef4f-4370-8c5d-5a632759b261 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.355176 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b1ba0079-ef4f-4370-8c5d-5a632759b261 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:53.541043 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b1ba0079-ef4f-4370-8c5d-5a632759b261 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:53.552530 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b1ba0079-ef4f-4370-8c5d-5a632759b261 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.210349 May 26 15:15:53.553607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 461/941] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:53 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:53.880519 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:53.881420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:53.893806 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.894606 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:53.895999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.896639 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:53.922985 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b HTTP/1.1 May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:53.926251 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.927612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '1fbe7683-005d-4728-8dcd-743fb3fc8a2b'} May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:53.928378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.932909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:53.936722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:53.936722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d853f152-3110-429d-bafc-3db0cbc118a6 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 404 len: 111 microversion: 2.1 time: 0.057587 May 26 15:15:53.936722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 481/942] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:53 2022] DELETE /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:53.940936 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:53.942003 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 1fbe7683-005d-4728-8dcd-743fb3fc8a2b] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:53.951008 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.951793 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:53.952926 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:53.954341 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:53.977635 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b HTTP/1.1 May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:15:53.981551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.983031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '1fbe7683-005d-4728-8dcd-743fb3fc8a2b'} May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:53.984174 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. May 26 15:15:53.986167 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:53.987483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 1fbe7683-005d-4728-8dcd-743fb3fc8a2b could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:53.987483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7de145dd-0a25-4383-ba63-48473825b6da tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b" status: 404 len: 111 microversion: 2.1 time: 0.048460 May 26 15:15:53.987483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 462/943] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:53 2022] GET /compute/v2.1/servers/1fbe7683-005d-4728-8dcd-743fb3fc8a2b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:53.994404 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:53.994909 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:54.003858 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:54.004675 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:54.006066 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:54.006764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:54.030196 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f HTTP/1.1 May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:54.032788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.034204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f'} May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:54.034962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.036172 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:54.037518 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:54.037518 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-43c70126-7a11-4c01-81ff-581bff71964a tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 404 len: 111 microversion: 2.1 time: 0.044739 May 26 15:15:54.037518 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 482/944] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:53 2022] DELETE /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:54.046943 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:54.048085 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:54.057187 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:54.057986 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:54.060251 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:54.060647 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:54.084430 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f HTTP/1.1 May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:15:54.087138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.088502 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f'} May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:54.089577 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. May 26 15:15:54.091151 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:15:54.092482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:54.092482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ca3a0f22-0a83-4b03-9599-69c250a948fe tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f" status: 404 len: 111 microversion: 2.1 time: 0.049070 May 26 15:15:54.092482 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 463/945] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:54 2022] GET /compute/v2.1/servers/9f79a65a-d2ae-450c-ae5e-8fb5c1181c3f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:54.573261 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8750ceee-a21b-4485-b33f-c0486c14bee7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:54.574908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8750ceee-a21b-4485-b33f-c0486c14bee7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:54.583311 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8750ceee-a21b-4485-b33f-c0486c14bee7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:54.583767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8750ceee-a21b-4485-b33f-c0486c14bee7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:54.584627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8750ceee-a21b-4485-b33f-c0486c14bee7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:54.585080 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8750ceee-a21b-4485-b33f-c0486c14bee7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:54.757974 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8750ceee-a21b-4485-b33f-c0486c14bee7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:54.767286 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8750ceee-a21b-4485-b33f-c0486c14bee7 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.200394 May 26 15:15:54.767874 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 483/946] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:54 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:55.788189 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-eee8b870-7687-4010-a012-8d77af9dea6f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:55.788816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-eee8b870-7687-4010-a012-8d77af9dea6f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:55.796710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eee8b870-7687-4010-a012-8d77af9dea6f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:55.797169 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eee8b870-7687-4010-a012-8d77af9dea6f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:55.798002 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eee8b870-7687-4010-a012-8d77af9dea6f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:55.798439 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-eee8b870-7687-4010-a012-8d77af9dea6f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:56.064687 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-eee8b870-7687-4010-a012-8d77af9dea6f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:56.072710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-eee8b870-7687-4010-a012-8d77af9dea6f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.288473 May 26 15:15:56.073550 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 464/947] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:55 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:57.095551 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-665793fd-a89b-4b98-9d43-f1e7959c8251 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:57.097778 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-665793fd-a89b-4b98-9d43-f1e7959c8251 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:57.103403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:57.112878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-665793fd-a89b-4b98-9d43-f1e7959c8251 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:57.113402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-665793fd-a89b-4b98-9d43-f1e7959c8251 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:57.114349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-665793fd-a89b-4b98-9d43-f1e7959c8251 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:57.115104 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-665793fd-a89b-4b98-9d43-f1e7959c8251 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:57.395502 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-665793fd-a89b-4b98-9d43-f1e7959c8251 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:57.399876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=100 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:15:57.406552 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-665793fd-a89b-4b98-9d43-f1e7959c8251 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.318877 May 26 15:15:57.407662 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 484/948] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:57 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:58.429543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a7d69239-6970-4887-9421-5e169d8b33c8 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:58.430752 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a7d69239-6970-4887-9421-5e169d8b33c8 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:58.439059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a7d69239-6970-4887-9421-5e169d8b33c8 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.441113 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a7d69239-6970-4887-9421-5e169d8b33c8 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.441999 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a7d69239-6970-4887-9421-5e169d8b33c8 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.442450 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a7d69239-6970-4887-9421-5e169d8b33c8 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.477440 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:58.478623 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:58.488285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.488777 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.489821 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.490257 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.513876 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 HTTP/1.1 May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:58.516178 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.517726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '957f4d2d-884d-44ff-9aee-1acf1b6c8959'} May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:58.518504 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.519726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.521244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:58.521244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b8fdd2c5-c683-4cc0-9da1-e1119df4b500 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "DELETE /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 404 len: 111 microversion: 2.1 time: 0.045719 May 26 15:15:58.521244 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 485/949] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:15:58 2022] DELETE /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:58.530264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:58.531186 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] [instance: 957f4d2d-884d-44ff-9aee-1acf1b6c8959] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:58.540362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.541731 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.543402 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.543950 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.565146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] HTTP exception thrown: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Request method failure captured: May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 HTTP/1.1 May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gVWuFDAb7ekiY0eSUrorpD9DvrMYRmRmNad7PPXeqD15O88mVNOeaOIrN6Hb2MBqzTQjtR8WmPFcxPoy7NFw4c2Cq-8eFU7pbVHfDWvHS1FX8bZW5ZE6qu9Au1hN5kEKjjkzv1xm1JcLDwOAVjKUxdJIM1rDfbbf0e0sFlG56bHQ4 May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:15:58.567149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9780d0cae62c4f5088060b530571ebb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9780d0cae62c4f5088060b530571ebb3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9780d0cae62c4f5088060b530571ebb3"}]}] May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 9780d0cae62c4f5088060b530571ebb3 May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-385929673 May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 2ce5b5d5a12743bc80a4b191c24ff52f May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeNegativeTest-385929673-project May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.568924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '957f4d2d-884d-44ff-9aee-1acf1b6c8959'} May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:15:58.569740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. May 26 15:15:58.571875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:15:58.573271 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] Returning 404 to user: Instance 957f4d2d-884d-44ff-9aee-1acf1b6c8959 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:15:58.573271 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-11500a9b-ab7b-45eb-80fc-dfaff0799e69 tempest-AttachVolumeNegativeTest-385929673 tempest-AttachVolumeNegativeTest-385929673-project] 10.222.0.46 "GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959" status: 404 len: 111 microversion: 2.1 time: 0.044873 May 26 15:15:58.573271 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 486/950] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:58 2022] GET /compute/v2.1/servers/957f4d2d-884d-44ff-9aee-1acf1b6c8959 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:15:58.655471 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a7d69239-6970-4887-9421-5e169d8b33c8 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:58.670644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a7d69239-6970-4887-9421-5e169d8b33c8 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.244820 May 26 15:15:58.672404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 465/951] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:58 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:58.857079 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-5949a829-0411-4ab2-9cc6-db1bf30b6a6f req-77f70ef1-35e1-4c00-aace-fffb3bdb6aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a80f2c7-1451-47b7-9f5e-3d53c21794ae", "name": "network-vif-plugged", "status": "completed", "tag": "919581af-7ccb-4d91-b17b-36af6ce1ee96"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:58.870612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5949a829-0411-4ab2-9cc6-db1bf30b6a6f req-77f70ef1-35e1-4c00-aace-fffb3bdb6aa4 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:58.870872 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5949a829-0411-4ab2-9cc6-db1bf30b6a6f req-77f70ef1-35e1-4c00-aace-fffb3bdb6aa4 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:58.902916 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-5949a829-0411-4ab2-9cc6-db1bf30b6a6f req-77f70ef1-35e1-4c00-aace-fffb3bdb6aa4 service nova] Creating event network-vif-plugged:919581af-7ccb-4d91-b17b-36af6ce1ee96 for instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae on hv-cinder-78836 May 26 15:15:58.919189 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-5949a829-0411-4ab2-9cc6-db1bf30b6a6f req-77f70ef1-35e1-4c00-aace-fffb3bdb6aa4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066439 May 26 15:15:58.919799 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 487/952] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:59.690474 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-7632ab66-4c2b-4441-881c-86766e87d15c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:59.691639 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-7632ab66-4c2b-4441-881c-86766e87d15c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:15:59.700421 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7632ab66-4c2b-4441-881c-86766e87d15c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.700882 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7632ab66-4c2b-4441-881c-86766e87d15c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.704166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7632ab66-4c2b-4441-881c-86766e87d15c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:15:59.704166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-7632ab66-4c2b-4441-881c-86766e87d15c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:15:59.857282 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-7632ab66-4c2b-4441-881c-86766e87d15c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:59.880105 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-7632ab66-4c2b-4441-881c-86766e87d15c tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1575 microversion: 2.1 time: 0.194926 May 26 15:15:59.880705 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 466/953] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:15:59 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:00.907380 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f612d2fd-fd21-4e4e-b1a5-f0485bfb22d5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:00.908228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f612d2fd-fd21-4e4e-b1a5-f0485bfb22d5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:00.922102 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f612d2fd-fd21-4e4e-b1a5-f0485bfb22d5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:00.923517 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f612d2fd-fd21-4e4e-b1a5-f0485bfb22d5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:00.925260 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f612d2fd-fd21-4e4e-b1a5-f0485bfb22d5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:00.926373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f612d2fd-fd21-4e4e-b1a5-f0485bfb22d5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:01.324069 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f612d2fd-fd21-4e4e-b1a5-f0485bfb22d5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:01.332485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f612d2fd-fd21-4e4e-b1a5-f0485bfb22d5 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1562 microversion: 2.1 time: 0.434490 May 26 15:16:01.333246 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 488/954] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:16:00 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1562 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:03.868171 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e70868d1-b13d-401c-a45d-7f605b188693 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:03.869130 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e70868d1-b13d-401c-a45d-7f605b188693 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:03.876806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e70868d1-b13d-401c-a45d-7f605b188693 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:03.877262 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e70868d1-b13d-401c-a45d-7f605b188693 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:03.878247 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e70868d1-b13d-401c-a45d-7f605b188693 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:03.878686 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e70868d1-b13d-401c-a45d-7f605b188693 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:03.913900 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e70868d1-b13d-401c-a45d-7f605b188693 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051258 May 26 15:16:03.917655 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 467/955] 10.222.0.46 () {60 vars in 1342 bytes} [Thu May 26 15:16:03 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:03.983139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bab2856f-c286-46cb-9d4c-d8fda223859f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:03.984301 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bab2856f-c286-46cb-9d4c-d8fda223859f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:03.996384 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bab2856f-c286-46cb-9d4c-d8fda223859f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:03.996856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bab2856f-c286-46cb-9d4c-d8fda223859f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:03.997707 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bab2856f-c286-46cb-9d4c-d8fda223859f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:03.998364 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bab2856f-c286-46cb-9d4c-d8fda223859f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:04.050942 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bab2856f-c286-46cb-9d4c-d8fda223859f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:16:04.172092 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bab2856f-c286-46cb-9d4c-d8fda223859f tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "DELETE /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 204 len: 0 microversion: 2.20 time: 0.192452 May 26 15:16:04.173755 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 489/956] 10.222.0.46 () {60 vars in 1279 bytes} [Thu May 26 15:16:03 2022] DELETE /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:16:04.183119 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:04.184225 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:04.191566 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:04.192391 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:04.193613 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:04.194299 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:04.405788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:04.418827 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:04.422075 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:04.424184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-4e074351-1dfe-4f21-87a1-8928b78f8f57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.245225 May 26 15:16:04.425616 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 468/957] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:04 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:04.796486 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-690b8769-8089-4aa0-b238-5872d8d0fb97 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Action: 'create', calling method: .version_select at 0x7ff966926820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-472302304", "metadata": {"Type": "work"}}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:05.144405 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-690b8769-8089-4aa0-b238-5872d8d0fb97 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.492834 May 26 15:16:05.145850 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 490/958] 10.222.0.46 () {60 vars in 1155 bytes} [Thu May 26 15:16:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 495 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 15:16:05.160554 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-df88faf0-e366-40a7-a2a2-2ef6349d9659 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff965939af0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:05.223979 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-df88faf0-e366-40a7-a2a2-2ef6349d9659 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 200 len: 352 microversion: 2.1 time: 0.068531 May 26 15:16:05.224944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 469/959] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:05 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:05.444094 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:05.444835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:05.451987 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:05.452441 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:05.453270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:05.453703 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:05.599582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:05.609148 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:05.610764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:05.612082 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5c4d664d-49d1-4471-aa95-431455db95f7 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.172044 May 26 15:16:05.612653 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 491/960] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:05 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:06.238573 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3d3bb54d-74d1-4723-b33a-6bf29c6b6cf3 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff965862310>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:06.293238 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3d3bb54d-74d1-4723-b33a-6bf29c6b6cf3 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 200 len: 352 microversion: 2.1 time: 0.059158 May 26 15:16:06.293881 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 470/961] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:06 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:06.638515 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:06.639130 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:06.646887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:06.647343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:06.648119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:06.648557 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:06.806452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:06.816866 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:06.818449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:06.819646 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-01e160b5-0575-4f45-936e-3d9fdc2c9ddc tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.185317 May 26 15:16:06.820201 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 492/962] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:06 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:07.307077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-152b954c-e390-4c5e-9953-c0584d67fe15 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff965870dc0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:07.366619 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-152b954c-e390-4c5e-9953-c0584d67fe15 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 200 len: 352 microversion: 2.1 time: 0.064056 May 26 15:16:07.367680 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 471/963] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:07 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:07.838106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:07.839607 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:07.846030 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:07.846482 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:07.847266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:07.847711 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:07.994634 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:08.002962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:08.004487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:08.005722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-1031ad57-4e2a-48da-8c30-d6864fbb3428 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.171592 May 26 15:16:08.006285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 493/964] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:07 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:08.383524 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-2c126fde-94c1-4587-8455-290a61d43211 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff965818310>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:08.434522 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-2c126fde-94c1-4587-8455-290a61d43211 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 200 len: 352 microversion: 2.1 time: 0.055212 May 26 15:16:08.435101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 472/965] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:08 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:09.024316 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:09.024927 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:09.032683 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:09.033138 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:09.034058 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:09.034501 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:09.185519 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:09.194166 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:09.195685 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:09.196855 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-56906e37-0c1c-440d-b469-a5d5c7b3942d tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.176537 May 26 15:16:09.197407 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 494/966] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:09 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:09.451187 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-341180ae-ca14-4528-bf43-d48778fe27e4 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff965939670>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:09.502444 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-341180ae-ca14-4528-bf43-d48778fe27e4 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 200 len: 352 microversion: 2.1 time: 0.056026 May 26 15:16:09.503175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 473/967] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:09 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:10.215219 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:10.216843 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:10.224049 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:10.224510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:10.225285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:10.226106 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:10.451955 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:10.460384 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:10.462182 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:10.463124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2c8bc359-75d2-4faf-80de-f91c14ba45d3 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1722 microversion: 2.20 time: 0.252004 May 26 15:16:10.463844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 495/968] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:10 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:10.515762 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f8ef0596-4a08-4342-94b6-03cba4e9e806 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff9658b4dc0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:10.584581 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f8ef0596-4a08-4342-94b6-03cba4e9e806 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 200 len: 353 microversion: 2.1 time: 0.073232 May 26 15:16:10.585561 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 474/969] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:10 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:10.596365 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ac06b70d-6b0d-4885-b6bd-135b9cbf4b89 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff965e8d5e0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:10.672201 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ac06b70d-6b0d-4885-b6bd-135b9cbf4b89 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 200 len: 353 microversion: 2.1 time: 0.079592 May 26 15:16:10.673298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 496/970] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:10 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:10.690189 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-35ded782-64ca-46f9-a6f2-fe0814738ac8 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff9659390d0>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:10.787701 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-35ded782-64ca-46f9-a6f2-fe0814738ac8 tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 202 len: 0 microversion: 2.1 time: 0.101355 May 26 15:16:10.788392 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 475/971] 10.222.0.46 () {58 vars in 1247 bytes} [Thu May 26 15:16:10 2022] DELETE /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:16:10.798266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5815764c-ca05-47df-bc2f-5df1f340f6ce tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff966999940>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:10.871997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5815764c-ca05-47df-bc2f-5df1f340f6ce tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 200 len: 352 microversion: 2.1 time: 0.078573 May 26 15:16:10.872887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 497/972] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:10 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 352 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:16:11.205280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-ef03a13c-f3b1-4d38-9431-798eec49f82d req-23edcb19-f715-47fa-9df8-4c9d92bbc8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "399eff3a-ae28-4b3d-a00c-36e004e509da", "name": "network-vif-deleted", "tag": "f7a772e1-226c-4379-8092-198295987b70"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:11.218098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-ef03a13c-f3b1-4d38-9431-798eec49f82d req-23edcb19-f715-47fa-9df8-4c9d92bbc8ed service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:11.218550 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-ef03a13c-f3b1-4d38-9431-798eec49f82d req-23edcb19-f715-47fa-9df8-4c9d92bbc8ed service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:11.254831 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-ef03a13c-f3b1-4d38-9431-798eec49f82d req-23edcb19-f715-47fa-9df8-4c9d92bbc8ed service nova] Creating event network-vif-deleted:f7a772e1-226c-4379-8092-198295987b70 for instance 399eff3a-ae28-4b3d-a00c-36e004e509da on hv-cinder-78836 May 26 15:16:11.267683 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-ef03a13c-f3b1-4d38-9431-798eec49f82d req-23edcb19-f715-47fa-9df8-4c9d92bbc8ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067457 May 26 15:16:11.268631 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 476/973] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:11.482336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:11.482944 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:11.489551 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:11.489941 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:11.490707 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:11.491165 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:11.526453 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:11.526946 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:11.527473 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lazy-loading 'fault' on Instance uuid 399eff3a-ae28-4b3d-a00c-36e004e509da {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:16:11.571360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:11.579906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:11.581417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64aeada36ebe460e9969f1f048651e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd732418a4b2247e59ed96898b21cf6b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:11.582588 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9ae59d67-7839-4f54-98d3-afcf32cbecd4 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 200 len: 1370 microversion: 2.20 time: 0.104883 May 26 15:16:11.583143 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 498/974] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:11 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:16:11.884778 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d3cad8fd-f40b-4ce6-93e5-1d298b4606ad tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Calling method '.version_select at 0x7ff9658b4940>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:11.925340 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-d3cad8fd-f40b-4ce6-93e5-1d298b4606ad tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] HTTP exception thrown: Volume 626fc260-b4e9-41bf-8049-2236c31f9ff0 could not be found. May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d3cad8fd-f40b-4ce6-93e5-1d298b4606ad tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Request method failure captured: May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 HTTP/1.1 May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5m0FYyyOaeCKaypfMt2LSeU6eR1CmGoAXT9h8PFbJOCbf_J859YyN51fb4j2anCsYNmrdj8egQ0R1iMcRAB58WRGSM96zL0O4JM76qHKyDooWDo7-ehQqFlBupfAY0AsWxpMjkHGwiz8zNNs_QW64gSMR8QdICP8fqWZ77Dn7OI6Yw May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: d22a20b14bd54530b45ded9388b93724 May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-VolumesGetTestJSON-1352554564 May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:16:11.927582 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d22a20b14bd54530b45ded9388b93724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d22a20b14bd54530b45ded9388b93724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d22a20b14bd54530b45ded9388b93724", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d22a20b14bd54530b45ded9388b93724"}]}] May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-VolumesGetTestJSON-1352554564 May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: d22a20b14bd54530b45ded9388b93724 May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-VolumesGetTestJSON-1352554564 May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-VolumesGetTestJSON-1352554564-project May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: a15d845b892b49efb41a6f72fe1db9f1 May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-VolumesGetTestJSON-1352554564-project May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Volume 626fc260-b4e9-41bf-8049-2236c31f9ff0 could not be found. May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '626fc260-b4e9-41bf-8049-2236c31f9ff0'} May 26 15:16:11.929320 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 626fc260-b4e9-41bf-8049-2236c31f9ff0 could not be found. (HTTP 404) (Request-ID: req-e57cfc44-9b41-4d7b-bd46-c3b91194dcaa) May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:11.930330 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 15:16:11.931911 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 626fc260-b4e9-41bf-8049-2236c31f9ff0 could not be found. May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 15:16:11.933441 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 626fc260-b4e9-41bf-8049-2236c31f9ff0 could not be found. May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 626fc260-b4e9-41bf-8049-2236c31f9ff0 could not be found. May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d3cad8fd-f40b-4ce6-93e5-1d298b4606ad tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] Returning 404 to user: Volume 626fc260-b4e9-41bf-8049-2236c31f9ff0 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d3cad8fd-f40b-4ce6-93e5-1d298b4606ad tempest-VolumesGetTestJSON-1352554564 tempest-VolumesGetTestJSON-1352554564-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0" status: 404 len: 109 microversion: 2.1 time: 0.048507 May 26 15:16:11.935622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 477/975] 10.222.0.46 () {58 vars in 1244 bytes} [Thu May 26 15:16:11 2022] GET /compute/v2.1/os-volumes/626fc260-b4e9-41bf-8049-2236c31f9ff0 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:16:12.600533 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:12.601146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:12.611125 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:12.611740 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:12.612907 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:12.613696 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:12.634673 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] HTTP exception thrown: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Request method failure captured: May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da HTTP/1.1 May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gUhO06JI6AeLiy_7dQ3CouXcrfPamsSamRsQvezK4atrv8EjQ69Nc7uZgXACo6Itq5VGV6w_Zf5onjCXm9VIpYD1CrcbLjNhOa8SHzsBx65Ex8uL0jCWXLejtAUHD4sFM9Ps1LmUhS1_LNKt5L1HGoMFQ6KOwt3yrZbr3l5Qy7AOI May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:16:12.638100 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d732418a4b2247e59ed96898b21cf6b1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d732418a4b2247e59ed96898b21cf6b1"}]}] May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 64aeada36ebe460e9969f1f048651e6d May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:12.640038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '399eff3a-ae28-4b3d-a00c-36e004e509da'} May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:12.641173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:12.643837 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:12.645370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Returning 404 to user: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:12.645370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2d38b43e-cdd4-4667-990e-3f927c2e9e57 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 404 len: 111 microversion: 2.20 time: 0.042087 May 26 15:16:12.645370 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 499/976] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:12 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:16:12.652912 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e6443944-d06b-4c74-b664-7bab75832163 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '.version_select at 0x7ff965862310>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:12.681838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e6443944-d06b-4c74-b664-7bab75832163 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-515244224" status: 204 len: 0 microversion: 2.20 time: 0.036090 May 26 15:16:12.683075 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 478/977] 10.222.0.46 () {60 vars in 1258 bytes} [Thu May 26 15:16:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-515244224 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:16:16.738474 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:16.739292 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:16.746890 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:16.747460 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:16.748132 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:16.748605 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:16.764262 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] HTTP exception thrown: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Request method failure captured: May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da HTTP/1.1 May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gUhO06JI6AeLiy_7dQ3CouXcrfPamsSamRsQvezK4atrv8EjQ69Nc7uZgXACo6Itq5VGV6w_Zf5onjCXm9VIpYD1CrcbLjNhOa8SHzsBx65Ex8uL0jCWXLejtAUHD4sFM9Ps1LmUhS1_LNKt5L1HGoMFQ6KOwt3yrZbr3l5Qy7AOI May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:16:16.765433 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d732418a4b2247e59ed96898b21cf6b1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d732418a4b2247e59ed96898b21cf6b1"}]}] May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 64aeada36ebe460e9969f1f048651e6d May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.767613 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '399eff3a-ae28-4b3d-a00c-36e004e509da'} May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:16.768630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.770067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:16.772373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Returning 404 to user: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:16.772373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-202bb278-4255-48d6-8ff6-ba1ede149da8 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "DELETE /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 404 len: 111 microversion: 2.20 time: 0.032983 May 26 15:16:16.772373 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 500/978] 10.222.0.46 () {60 vars in 1279 bytes} [Thu May 26 15:16:16 2022] DELETE /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:16:16.776658 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:16.777412 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 399eff3a-ae28-4b3d-a00c-36e004e509da] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:16.784516 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:16.784796 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:16.785617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:16.786071 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:16.789189 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=83 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:16.801221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] HTTP exception thrown: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Request method failure captured: May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da HTTP/1.1 May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gUhO06JI6AeLiy_7dQ3CouXcrfPamsSamRsQvezK4atrv8EjQ69Nc7uZgXACo6Itq5VGV6w_Zf5onjCXm9VIpYD1CrcbLjNhOa8SHzsBx65Ex8uL0jCWXLejtAUHD4sFM9Ps1LmUhS1_LNKt5L1HGoMFQ6KOwt3yrZbr3l5Qy7AOI May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:16:16.802855 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d732418a4b2247e59ed96898b21cf6b1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d732418a4b2247e59ed96898b21cf6b1"}]}] May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 64aeada36ebe460e9969f1f048651e6d May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.804929 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '399eff3a-ae28-4b3d-a00c-36e004e509da'} May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:16.805884 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. May 26 15:16:16.807890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:16.809184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Returning 404 to user: Instance 399eff3a-ae28-4b3d-a00c-36e004e509da could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:16.809184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8fc27e4d-4185-473c-97cd-8fbf55cb1d78 tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da" status: 404 len: 111 microversion: 2.20 time: 0.032577 May 26 15:16:16.809184 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 479/979] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:16 2022] GET /compute/v2.1/servers/399eff3a-ae28-4b3d-a00c-36e004e509da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 15:16:17.966029 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:17.966852 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:17.978664 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:17.979455 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:17.980921 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:17.981775 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:18.000532 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] HTTP exception thrown: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Request method failure captured: May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 HTTP/1.1 May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5gUhO06JI6AeLiy_7dQ3CouXcrfPamsSamRsQvezK4atrv8EjQ69Nc7uZgXACo6Itq5VGV6w_Zf5onjCXm9VIpYD1CrcbLjNhOa8SHzsBx65Ex8uL0jCWXLejtAUHD4sFM9Ps1LmUhS1_LNKt5L1HGoMFQ6KOwt3yrZbr3l5Qy7AOI May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:16:18.002230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d732418a4b2247e59ed96898b21cf6b1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d732418a4b2247e59ed96898b21cf6b1"}]}] May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 64aeada36ebe460e9969f1f048651e6d May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.003877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': '06cf01b4-e458-498b-990e-33b4171e1a14'} May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:18.004766 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.006306 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:16:18.008432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Returning 404 to user: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:18.008432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ddf5c04f-b39c-4d58-b956-3b35855bef2a tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "DELETE /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 404 len: 111 microversion: 2.20 time: 0.048576 May 26 15:16:18.008432 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 501/980] 10.222.0.46 () {60 vars in 1279 bytes} [Thu May 26 15:16:17 2022] DELETE /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 15:16:18.020216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:18.021888 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] [instance: 06cf01b4-e458-498b-990e-33b4171e1a14] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:18.029785 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:18.041431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:18.041431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:18.041431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:18.041431 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:18.068456 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] HTTP exception thrown: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Request method failure captured: May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 HTTP/1.1 May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5gUhO06JI6AeLiy_7dQ3CouXcrfPamsSamRsQvezK4atrv8EjQ69Nc7uZgXACo6Itq5VGV6w_Zf5onjCXm9VIpYD1CrcbLjNhOa8SHzsBx65Ex8uL0jCWXLejtAUHD4sFM9Ps1LmUhS1_LNKt5L1HGoMFQ6KOwt3yrZbr3l5Qy7AOI May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Openstack-Nova-Api-Version: 2.20 May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:16:18.071286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d732418a4b2247e59ed96898b21cf6b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d732418a4b2247e59ed96898b21cf6b1", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d732418a4b2247e59ed96898b21cf6b1"}]}] May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: d732418a4b2247e59ed96898b21cf6b1 May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1937526415 May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 64aeada36ebe460e9969f1f048651e6d May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1937526415-project May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.074840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '06cf01b4-e458-498b-990e-33b4171e1a14'} May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:16:18.076738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. May 26 15:16:18.079278 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:16:18.080771 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] Returning 404 to user: Instance 06cf01b4-e458-498b-990e-33b4171e1a14 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:16:18.080771 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f2ac8653-42e3-4c3e-8d3d-98f4f547b9ed tempest-AttachVolumeShelveTestJSON-1937526415 tempest-AttachVolumeShelveTestJSON-1937526415-project] 10.222.0.46 "GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14" status: 404 len: 111 microversion: 2.20 time: 0.065073 May 26 15:16:18.080771 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 480/981] 10.222.0.46 () {60 vars in 1276 bytes} [Thu May 26 15:16:18 2022] GET /compute/v2.1/servers/06cf01b4-e458-498b-990e-33b4171e1a14 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:16:49.787470 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-71c81096-0a43-4290-bd8e-52a03735579c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Action: 'create', calling method: .version_select at 0x7ff96699ae50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1582104497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6DxtfMRJc3KUS4FzuI3TOyoaHf06D1azbFCmkGNdHcRJqA9094mbqE6P9DX8anh34WZQe0iwBnbJGQSqXGPOSVncuYrlzDtsvs4/+4D4LFGkAPHMAOavcQbbAeReh+Qg=="}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:49.792242 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:49.792881 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:49.807514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-71c81096-0a43-4290-bd8e-52a03735579c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Getting quotas for project fb7e58e0c6954bb5ae0fafee4c7a6724. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:16:49.811544 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-71c81096-0a43-4290-bd8e-52a03735579c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Getting quotas for user e6e2622df88f4e1b9b81097d6e558f21 and project fb7e58e0c6954bb5ae0fafee4c7a6724. Resources: {'key_pairs'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:16:49.842780 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-71c81096-0a43-4290-bd8e-52a03735579c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059273 May 26 15:16:49.843428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 502/982] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:16:49 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:16:49.958880 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1501737878", "imageRef": "bf30bee7-faf8-440c-bbc9-121718e99eea", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1582104497", "networks": [{"uuid": "0cad89fc-1f08-469a-b236-e51174ed7e88"}]}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:49.967543 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:49.968177 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:16:50.016619 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.network.neutron [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] validate_networks() for [('0cad89fc-1f08-469a-b236-e51174ed7e88', None, None, None, None, None)] {{(pid=117724) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:16:50.512426 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Flavor limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:16:50.512858 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Image limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:16:50.513338 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Flavor pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:16:50.513782 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Image pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:16:50.514201 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:16:50.523170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:50.523630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:50.524479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:50.525479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:50.542815 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Getting quotas for project fb7e58e0c6954bb5ae0fafee4c7a6724. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:16:50.547442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Getting quotas for user e6e2622df88f4e1b9b81097d6e558f21 and project fb7e58e0c6954bb5ae0fafee4c7a6724. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:16:50.559397 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Going to run 1 instances... {{(pid=117724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:16:50.561656 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf30bee7-faf8-440c-bbc9-121718e99eea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:16:50.611886 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-2bd7193d-1c1b-4747-9ac9-d1897f0e91a1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657207 May 26 15:16:50.612563 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 481/983] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:16:50.623935 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bc573e5c-69c6-489a-be1e-838a9a833459 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:50.624557 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bc573e5c-69c6-489a-be1e-838a9a833459 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:50.683543 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bc573e5c-69c6-489a-be1e-838a9a833459 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:50.691492 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bc573e5c-69c6-489a-be1e-838a9a833459 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1259 microversion: 2.1 time: 0.071775 May 26 15:16:50.692073 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 503/984] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:16:50 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:51.709363 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-138133e8-1b9a-4418-8e34-74659fe5dabb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:51.710006 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-138133e8-1b9a-4418-8e34-74659fe5dabb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:51.718242 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-138133e8-1b9a-4418-8e34-74659fe5dabb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:51.718696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-138133e8-1b9a-4418-8e34-74659fe5dabb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:51.719472 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-138133e8-1b9a-4418-8e34-74659fe5dabb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:51.719955 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-138133e8-1b9a-4418-8e34-74659fe5dabb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:51.795950 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-138133e8-1b9a-4418-8e34-74659fe5dabb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:51.806003 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-138133e8-1b9a-4418-8e34-74659fe5dabb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1319 microversion: 2.1 time: 0.100412 May 26 15:16:51.806579 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 482/985] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:16:51 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1319 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:52.827277 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6c206458-ae41-490c-acc7-f46b03a2079a tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:52.828855 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6c206458-ae41-490c-acc7-f46b03a2079a tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:52.879234 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c206458-ae41-490c-acc7-f46b03a2079a tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:52.882612 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c206458-ae41-490c-acc7-f46b03a2079a tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:52.887823 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c206458-ae41-490c-acc7-f46b03a2079a tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:52.892090 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6c206458-ae41-490c-acc7-f46b03a2079a tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:53.559203 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6c206458-ae41-490c-acc7-f46b03a2079a tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:53.575468 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6c206458-ae41-490c-acc7-f46b03a2079a tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.755410 May 26 15:16:53.584936 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 504/986] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:16:52 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:54.639379 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e2ae554b-c94a-4ff0-b6ff-8b0c3adce257 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:54.640315 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e2ae554b-c94a-4ff0-b6ff-8b0c3adce257 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:54.652213 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2ae554b-c94a-4ff0-b6ff-8b0c3adce257 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:54.652737 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2ae554b-c94a-4ff0-b6ff-8b0c3adce257 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:54.653766 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2ae554b-c94a-4ff0-b6ff-8b0c3adce257 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:54.654283 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e2ae554b-c94a-4ff0-b6ff-8b0c3adce257 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:55.091139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-3d7b0d78-e918-430b-a228-68ee910be068 req-8e750769-0a2c-431c-9252-a2ebc52a8d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9563934-7879-4c30-8ae5-53605ba0b017", "tag": "b41d02f4-ab49-441e-b927-18bb558b79ce"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:16:55.109007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-3d7b0d78-e918-430b-a228-68ee910be068 req-8e750769-0a2c-431c-9252-a2ebc52a8d35 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:55.109490 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-3d7b0d78-e918-430b-a228-68ee910be068 req-8e750769-0a2c-431c-9252-a2ebc52a8d35 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:55.157109 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e2ae554b-c94a-4ff0-b6ff-8b0c3adce257 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:55.172408 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-3d7b0d78-e918-430b-a228-68ee910be068 req-8e750769-0a2c-431c-9252-a2ebc52a8d35 service nova] Creating event network-changed:b41d02f4-ab49-441e-b927-18bb558b79ce for instance c9563934-7879-4c30-8ae5-53605ba0b017 on hv-cinder-78836 May 26 15:16:55.197124 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e2ae554b-c94a-4ff0-b6ff-8b0c3adce257 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.578456 May 26 15:16:55.197860 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-3d7b0d78-e918-430b-a228-68ee910be068 req-8e750769-0a2c-431c-9252-a2ebc52a8d35 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110357 May 26 15:16:55.200542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 483/987] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:16:54 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:55.201226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 505/988] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:16:56.223813 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-28984170-2689-4e14-be4d-e4ad6f076915 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:56.225644 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-28984170-2689-4e14-be4d-e4ad6f076915 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:56.235094 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28984170-2689-4e14-be4d-e4ad6f076915 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:56.235957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28984170-2689-4e14-be4d-e4ad6f076915 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:56.237121 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28984170-2689-4e14-be4d-e4ad6f076915 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:56.237850 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28984170-2689-4e14-be4d-e4ad6f076915 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:56.527411 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-28984170-2689-4e14-be4d-e4ad6f076915 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:56.541614 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-28984170-2689-4e14-be4d-e4ad6f076915 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.323378 May 26 15:16:56.543147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 484/989] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:16:56 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:57.579343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a13a42df-074d-4d80-8596-504b95b25a89 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:57.580592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a13a42df-074d-4d80-8596-504b95b25a89 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:57.607812 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a13a42df-074d-4d80-8596-504b95b25a89 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:57.608560 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a13a42df-074d-4d80-8596-504b95b25a89 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:57.610159 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a13a42df-074d-4d80-8596-504b95b25a89 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:57.617199 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a13a42df-074d-4d80-8596-504b95b25a89 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:58.014754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a13a42df-074d-4d80-8596-504b95b25a89 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:58.025887 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a13a42df-074d-4d80-8596-504b95b25a89 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.462763 May 26 15:16:58.027842 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 506/990] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:16:57 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:16:59.073108 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a8bf190c-9deb-41c1-99dd-30856727cd2e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:16:59.076399 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a8bf190c-9deb-41c1-99dd-30856727cd2e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:16:59.090979 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a8bf190c-9deb-41c1-99dd-30856727cd2e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:59.102726 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a8bf190c-9deb-41c1-99dd-30856727cd2e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:59.110110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a8bf190c-9deb-41c1-99dd-30856727cd2e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:16:59.111072 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a8bf190c-9deb-41c1-99dd-30856727cd2e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:16:59.485841 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a8bf190c-9deb-41c1-99dd-30856727cd2e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:16:59.493764 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a8bf190c-9deb-41c1-99dd-30856727cd2e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.450798 May 26 15:16:59.494699 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 485/991] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:16:59 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:00.513561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-164be838-1623-47d6-ba90-d217196488ea tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:00.514398 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-164be838-1623-47d6-ba90-d217196488ea tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:00.521616 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-164be838-1623-47d6-ba90-d217196488ea tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:00.522188 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-164be838-1623-47d6-ba90-d217196488ea tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:00.523046 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-164be838-1623-47d6-ba90-d217196488ea tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:00.524087 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-164be838-1623-47d6-ba90-d217196488ea tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:00.689185 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:00.718249 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-164be838-1623-47d6-ba90-d217196488ea tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:00.727849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-164be838-1623-47d6-ba90-d217196488ea tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.218748 May 26 15:17:00.728724 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 507/992] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:00 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:17:01.748583 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d7dd275a-56c8-4ff7-956b-ce0f3cec0edb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:01.749183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d7dd275a-56c8-4ff7-956b-ce0f3cec0edb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:01.751420 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:01.752076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=6 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:01.757876 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d7dd275a-56c8-4ff7-956b-ce0f3cec0edb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:01.758327 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d7dd275a-56c8-4ff7-956b-ce0f3cec0edb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:01.759098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d7dd275a-56c8-4ff7-956b-ce0f3cec0edb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:01.759537 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d7dd275a-56c8-4ff7-956b-ce0f3cec0edb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:01.921200 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d7dd275a-56c8-4ff7-956b-ce0f3cec0edb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:01.928642 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d7dd275a-56c8-4ff7-956b-ce0f3cec0edb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.184035 May 26 15:17:01.929147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 486/993] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:01 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:02.945141 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-2fc0aa70-6dcd-4661-bec8-63eefe05dca4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:02.945827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-2fc0aa70-6dcd-4661-bec8-63eefe05dca4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:02.953269 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2fc0aa70-6dcd-4661-bec8-63eefe05dca4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:02.953779 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2fc0aa70-6dcd-4661-bec8-63eefe05dca4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:02.954537 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2fc0aa70-6dcd-4661-bec8-63eefe05dca4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:02.955007 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-2fc0aa70-6dcd-4661-bec8-63eefe05dca4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:03.171598 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-2fc0aa70-6dcd-4661-bec8-63eefe05dca4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:03.179255 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-2fc0aa70-6dcd-4661-bec8-63eefe05dca4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.238198 May 26 15:17:03.180480 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 508/994] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:02 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:17:04.196659 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9dfd9057-1f89-4901-a3b7-e2896a62525d tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:04.198143 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9dfd9057-1f89-4901-a3b7-e2896a62525d tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:04.204928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9dfd9057-1f89-4901-a3b7-e2896a62525d tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:04.205387 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9dfd9057-1f89-4901-a3b7-e2896a62525d tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:04.206315 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9dfd9057-1f89-4901-a3b7-e2896a62525d tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:04.206883 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9dfd9057-1f89-4901-a3b7-e2896a62525d tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:04.439304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9dfd9057-1f89-4901-a3b7-e2896a62525d tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:04.447952 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9dfd9057-1f89-4901-a3b7-e2896a62525d tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.255521 May 26 15:17:04.448740 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 487/995] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:04 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:05.464379 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9fa797e2-87f4-4c41-acb6-4bf235a3d5c3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:05.465290 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9fa797e2-87f4-4c41-acb6-4bf235a3d5c3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:05.472264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa797e2-87f4-4c41-acb6-4bf235a3d5c3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:05.472904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa797e2-87f4-4c41-acb6-4bf235a3d5c3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:05.474319 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa797e2-87f4-4c41-acb6-4bf235a3d5c3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:05.474942 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9fa797e2-87f4-4c41-acb6-4bf235a3d5c3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:05.641905 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9fa797e2-87f4-4c41-acb6-4bf235a3d5c3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:05.649966 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9fa797e2-87f4-4c41-acb6-4bf235a3d5c3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.189666 May 26 15:17:05.650539 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 509/996] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:05 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:06.669232 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8ad5fa00-2dde-4a01-8059-32815230bc5f tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:06.669889 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8ad5fa00-2dde-4a01-8059-32815230bc5f tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:06.677403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8ad5fa00-2dde-4a01-8059-32815230bc5f tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:06.677916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8ad5fa00-2dde-4a01-8059-32815230bc5f tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:06.678683 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8ad5fa00-2dde-4a01-8059-32815230bc5f tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:06.679118 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8ad5fa00-2dde-4a01-8059-32815230bc5f tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:06.843910 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8ad5fa00-2dde-4a01-8059-32815230bc5f tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:06.852538 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8ad5fa00-2dde-4a01-8059-32815230bc5f tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.189790 May 26 15:17:06.853100 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 488/997] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:06 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:07.588816 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-9f68023d-3a28-4415-b246-8b4790d78d93 req-7428bd27-4904-495a-ab7b-f892e47a3d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9563934-7879-4c30-8ae5-53605ba0b017", "name": "network-vif-plugged", "status": "completed", "tag": "b41d02f4-ab49-441e-b927-18bb558b79ce"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:07.600057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-9f68023d-3a28-4415-b246-8b4790d78d93 req-7428bd27-4904-495a-ab7b-f892e47a3d02 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:07.600758 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-9f68023d-3a28-4415-b246-8b4790d78d93 req-7428bd27-4904-495a-ab7b-f892e47a3d02 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:07.633767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-9f68023d-3a28-4415-b246-8b4790d78d93 req-7428bd27-4904-495a-ab7b-f892e47a3d02 service nova] Creating event network-vif-plugged:b41d02f4-ab49-441e-b927-18bb558b79ce for instance c9563934-7879-4c30-8ae5-53605ba0b017 on hv-cinder-78836 May 26 15:17:07.640322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-9f68023d-3a28-4415-b246-8b4790d78d93 req-7428bd27-4904-495a-ab7b-f892e47a3d02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055140 May 26 15:17:07.641785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 510/998] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:07.870159 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5d71aaf9-8c57-41fa-b4e7-58faa24e134c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:07.871444 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5d71aaf9-8c57-41fa-b4e7-58faa24e134c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:07.879950 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d71aaf9-8c57-41fa-b4e7-58faa24e134c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:07.880999 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d71aaf9-8c57-41fa-b4e7-58faa24e134c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:07.881852 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d71aaf9-8c57-41fa-b4e7-58faa24e134c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:07.882628 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5d71aaf9-8c57-41fa-b4e7-58faa24e134c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:08.150747 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5d71aaf9-8c57-41fa-b4e7-58faa24e134c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:08.164937 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5d71aaf9-8c57-41fa-b4e7-58faa24e134c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.298934 May 26 15:17:08.178196 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 489/999] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:07 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:09.190928 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-59579e77-7be2-4ca0-856f-b47b527dd7b3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:09.191724 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-59579e77-7be2-4ca0-856f-b47b527dd7b3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:09.199298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59579e77-7be2-4ca0-856f-b47b527dd7b3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:09.199802 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59579e77-7be2-4ca0-856f-b47b527dd7b3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:09.200575 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59579e77-7be2-4ca0-856f-b47b527dd7b3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:09.201018 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-59579e77-7be2-4ca0-856f-b47b527dd7b3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:09.350783 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-59579e77-7be2-4ca0-856f-b47b527dd7b3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:09.359363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-59579e77-7be2-4ca0-856f-b47b527dd7b3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1359 microversion: 2.1 time: 0.173262 May 26 15:17:09.359885 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 511/1000] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:09 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:10.377559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-59a4207b-b155-4211-a20e-23d024fb91f4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:10.378867 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-59a4207b-b155-4211-a20e-23d024fb91f4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:10.386435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-59a4207b-b155-4211-a20e-23d024fb91f4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:10.387969 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-59a4207b-b155-4211-a20e-23d024fb91f4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:10.388981 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-59a4207b-b155-4211-a20e-23d024fb91f4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:10.389609 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-59a4207b-b155-4211-a20e-23d024fb91f4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:10.858214 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-59a4207b-b155-4211-a20e-23d024fb91f4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:10.866432 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-59a4207b-b155-4211-a20e-23d024fb91f4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1550 microversion: 2.1 time: 0.493014 May 26 15:17:10.867156 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 490/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:10 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1550 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:10.884338 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-873cf4bf-487f-49be-8675-955e66bf3d23 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:10.885196 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-873cf4bf-487f-49be-8675-955e66bf3d23 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:10.892744 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-873cf4bf-487f-49be-8675-955e66bf3d23 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:10.893139 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-873cf4bf-487f-49be-8675-955e66bf3d23 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:10.893936 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-873cf4bf-487f-49be-8675-955e66bf3d23 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:10.894592 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-873cf4bf-487f-49be-8675-955e66bf3d23 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:11.059582 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-873cf4bf-487f-49be-8675-955e66bf3d23 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:11.068726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-873cf4bf-487f-49be-8675-955e66bf3d23 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1550 microversion: 2.1 time: 0.188554 May 26 15:17:11.069289 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 512/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:10 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1550 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:11.085137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:11.089199 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:11.090175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Searching by: {'deleted': False, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724'} {{(pid=117724) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 15:17:11.097162 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:11.097710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:11.098625 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:11.099068 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:11.199248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.multi_cell_list [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117724) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 15:17:11.298304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-caeb4c62-d6d1-454f-a0ab-1c679ce4f26e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.217397 May 26 15:17:11.304037 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 491/1003] 10.222.0.46 () {58 vars in 1124 bytes} [Thu May 26 15:17:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:11.309997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3157e449-6ae2-46b6-a985-1695c7331686 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:11.310630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3157e449-6ae2-46b6-a985-1695c7331686 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:11.317920 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3157e449-6ae2-46b6-a985-1695c7331686 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:11.318383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3157e449-6ae2-46b6-a985-1695c7331686 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:11.319170 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3157e449-6ae2-46b6-a985-1695c7331686 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:11.320344 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3157e449-6ae2-46b6-a985-1695c7331686 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:11.500116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3157e449-6ae2-46b6-a985-1695c7331686 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:11.510184 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3157e449-6ae2-46b6-a985-1695c7331686 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1550 microversion: 2.1 time: 0.204411 May 26 15:17:11.511135 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 513/1004] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:11 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1550 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:13.215870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-81bc4fc4-b03e-4ae9-82c3-b6bfe4f1768c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56826227-5d7b-4c8e-8b8a-ec16ccd19e59"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:13.217049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-81bc4fc4-b03e-4ae9-82c3-b6bfe4f1768c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:13.223583 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-81bc4fc4-b03e-4ae9-82c3-b6bfe4f1768c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:13.224039 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-81bc4fc4-b03e-4ae9-82c3-b6bfe4f1768c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:13.224804 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-81bc4fc4-b03e-4ae9-82c3-b6bfe4f1768c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:13.225249 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-81bc4fc4-b03e-4ae9-82c3-b6bfe4f1768c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:13.535035 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-81bc4fc4-b03e-4ae9-82c3-b6bfe4f1768c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "POST /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323071 May 26 15:17:13.535761 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 492/1005] 10.222.0.46 () {60 vars in 1322 bytes} [Thu May 26 15:17:13 2022] POST /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:15.394448 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:17:15.395033 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Thu May 26 15:17:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:17:21.247062 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-9f8063c6-f720-418e-83a3-f067db1403d4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:21.248149 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-9f8063c6-f720-418e-83a3-f067db1403d4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:21.254265 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:21.256294 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9f8063c6-f720-418e-83a3-f067db1403d4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:21.256991 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9f8063c6-f720-418e-83a3-f067db1403d4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:21.258233 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9f8063c6-f720-418e-83a3-f067db1403d4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:21.258363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-9f8063c6-f720-418e-83a3-f067db1403d4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:21.264788 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=53 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:21.447021 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-9f8063c6-f720-418e-83a3-f067db1403d4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:21.456733 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-9f8063c6-f720-418e-83a3-f067db1403d4 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1596 microversion: 2.1 time: 0.216318 May 26 15:17:21.457427 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 514/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:21 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1596 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:17:24.616342 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-36c96a93-3f70-4f3e-abf1-023d89a943a2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:24.617410 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-36c96a93-3f70-4f3e-abf1-023d89a943a2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:24.630616 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-5460beb3-a833-43cf-bea4-002b9992a9d1 req-734769fc-db3d-47ea-b440-cfe98d0293be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a80f2c7-1451-47b7-9f5e-3d53c21794ae", "tag": "919581af-7ccb-4d91-b17b-36af6ce1ee96"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:24.635949 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:24.642717 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:24.643732 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5460beb3-a833-43cf-bea4-002b9992a9d1 req-734769fc-db3d-47ea-b440-cfe98d0293be service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:24.644426 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-5460beb3-a833-43cf-bea4-002b9992a9d1 req-734769fc-db3d-47ea-b440-cfe98d0293be service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:24.648410 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:24.664105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-5460beb3-a833-43cf-bea4-002b9992a9d1 req-734769fc-db3d-47ea-b440-cfe98d0293be service nova] Creating event network-changed:919581af-7ccb-4d91-b17b-36af6ce1ee96 for instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae on hv-cinder-78836 May 26 15:17:24.673419 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-5460beb3-a833-43cf-bea4-002b9992a9d1 req-734769fc-db3d-47ea-b440-cfe98d0293be service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050071 May 26 15:17:24.676054 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36c96a93-3f70-4f3e-abf1-023d89a943a2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:24.678466 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36c96a93-3f70-4f3e-abf1-023d89a943a2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:24.679584 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 515/1007] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:17:24.680593 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36c96a93-3f70-4f3e-abf1-023d89a943a2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:24.688012 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-36c96a93-3f70-4f3e-abf1-023d89a943a2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:24.804322 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-36c96a93-3f70-4f3e-abf1-023d89a943a2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:17:24.990135 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-36c96a93-3f70-4f3e-abf1-023d89a943a2 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 204 len: 0 microversion: 2.1 time: 0.384033 May 26 15:17:24.991977 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 493/1008] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:17:24 2022] DELETE /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:17:25.002216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-18fcb8c4-ea42-4e67-b710-1e16d832e904 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:25.003291 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-18fcb8c4-ea42-4e67-b710-1e16d832e904 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:25.011837 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-18fcb8c4-ea42-4e67-b710-1e16d832e904 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:25.015477 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-18fcb8c4-ea42-4e67-b710-1e16d832e904 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:25.018023 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-18fcb8c4-ea42-4e67-b710-1e16d832e904 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:25.021343 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-18fcb8c4-ea42-4e67-b710-1e16d832e904 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:25.034385 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-41c68e4a-8fd4-4a48-8182-5a5651e5895f req-2ca7990c-e138-46a3-93fe-694d6fe02f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9563934-7879-4c30-8ae5-53605ba0b017", "tag": "b41d02f4-ab49-441e-b927-18bb558b79ce"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:25.048805 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-41c68e4a-8fd4-4a48-8182-5a5651e5895f req-2ca7990c-e138-46a3-93fe-694d6fe02f8b service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:25.049875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-41c68e4a-8fd4-4a48-8182-5a5651e5895f req-2ca7990c-e138-46a3-93fe-694d6fe02f8b service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:25.064359 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-41c68e4a-8fd4-4a48-8182-5a5651e5895f req-2ca7990c-e138-46a3-93fe-694d6fe02f8b service nova] Creating event network-changed:b41d02f4-ab49-441e-b927-18bb558b79ce for instance c9563934-7879-4c30-8ae5-53605ba0b017 on hv-cinder-78836 May 26 15:17:25.070995 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-41c68e4a-8fd4-4a48-8182-5a5651e5895f req-2ca7990c-e138-46a3-93fe-694d6fe02f8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303553 May 26 15:17:25.072302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 516/1009] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:17:25.262298 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-18fcb8c4-ea42-4e67-b710-1e16d832e904 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:25.276089 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-18fcb8c4-ea42-4e67-b710-1e16d832e904 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.275859 May 26 15:17:25.277364 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 494/1010] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:24 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:26.297510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-ce895fb5-bbb6-430b-b76a-a50b115c1fba tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:26.298785 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-ce895fb5-bbb6-430b-b76a-a50b115c1fba tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:26.306359 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce895fb5-bbb6-430b-b76a-a50b115c1fba tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:26.306884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce895fb5-bbb6-430b-b76a-a50b115c1fba tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:26.307827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce895fb5-bbb6-430b-b76a-a50b115c1fba tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:26.318604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-ce895fb5-bbb6-430b-b76a-a50b115c1fba tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:26.336668 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6cbc4115-749d-4c70-abed-6388f5f2615c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-791974402"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:26.337986 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6cbc4115-749d-4c70-abed-6388f5f2615c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:26.345044 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6cbc4115-749d-4c70-abed-6388f5f2615c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:26.345511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6cbc4115-749d-4c70-abed-6388f5f2615c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:26.346623 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6cbc4115-749d-4c70-abed-6388f5f2615c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:26.348005 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6cbc4115-749d-4c70-abed-6388f5f2615c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:26.757169 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.network.security_group_api [None req-6cbc4115-749d-4c70-abed-6388f5f2615c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Adding security group 92072407-b5c0-4931-ab59-d0a3a5bfc720 to port b41d02f4-ab49-441e-b927-18bb558b79ce May 26 15:17:26.768890 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-ce895fb5-bbb6-430b-b76a-a50b115c1fba tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:26.777388 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-ce895fb5-bbb6-430b-b76a-a50b115c1fba tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1568 microversion: 2.1 time: 0.485353 May 26 15:17:26.778225 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 517/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:26 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1568 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:17:27.676017 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-48685abf-3a8c-4b1b-b5f0-91d6ed892a75 req-9136dc41-87c1-4429-8a8a-5ceed4e62c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a80f2c7-1451-47b7-9f5e-3d53c21794ae", "name": "network-vif-deleted", "tag": "919581af-7ccb-4d91-b17b-36af6ce1ee96"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:27.688117 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-48685abf-3a8c-4b1b-b5f0-91d6ed892a75 req-9136dc41-87c1-4429-8a8a-5ceed4e62c4a service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:27.688877 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-48685abf-3a8c-4b1b-b5f0-91d6ed892a75 req-9136dc41-87c1-4429-8a8a-5ceed4e62c4a service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:27.715285 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-48685abf-3a8c-4b1b-b5f0-91d6ed892a75 req-9136dc41-87c1-4429-8a8a-5ceed4e62c4a service nova] Creating event network-vif-deleted:919581af-7ccb-4d91-b17b-36af6ce1ee96 for instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae on hv-cinder-78836 May 26 15:17:27.723103 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-48685abf-3a8c-4b1b-b5f0-91d6ed892a75 req-9136dc41-87c1-4429-8a8a-5ceed4e62c4a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053006 May 26 15:17:27.724657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 518/1012] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:17:27.798780 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cddd7b77-74bc-472c-8ad9-a7a0f672e945 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:27.800349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cddd7b77-74bc-472c-8ad9-a7a0f672e945 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:27.809760 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cddd7b77-74bc-472c-8ad9-a7a0f672e945 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:27.810945 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cddd7b77-74bc-472c-8ad9-a7a0f672e945 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:27.812004 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cddd7b77-74bc-472c-8ad9-a7a0f672e945 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:27.812793 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cddd7b77-74bc-472c-8ad9-a7a0f672e945 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:27.958414 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6cbc4115-749d-4c70-abed-6388f5f2615c tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "POST /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/action" status: 202 len: 0 microversion: 2.1 time: 1.625898 May 26 15:17:27.959376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 495/1013] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:17:26 2022] POST /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/action => generated 0 bytes in 1627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:17:27.967640 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-d7451c76-1bd5-4e39-a575-e6f1a9b018fb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:27.972404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-d7451c76-1bd5-4e39-a575-e6f1a9b018fb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:27.980017 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d7451c76-1bd5-4e39-a575-e6f1a9b018fb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:27.980474 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d7451c76-1bd5-4e39-a575-e6f1a9b018fb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:27.988560 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d7451c76-1bd5-4e39-a575-e6f1a9b018fb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:27.991783 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-d7451c76-1bd5-4e39-a575-e6f1a9b018fb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:28.023698 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-cddd7b77-74bc-472c-8ad9-a7a0f672e945 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:28.036747 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cddd7b77-74bc-472c-8ad9-a7a0f672e945 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1219 microversion: 2.1 time: 0.245190 May 26 15:17:28.041759 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 519/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:27 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1219 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:17:28.050028 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-ee4d6739-742c-49dd-a84f-ffcf59828898 req-ed28991a-ea13-443f-99aa-2b6e83f5e4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9563934-7879-4c30-8ae5-53605ba0b017", "tag": "b41d02f4-ab49-441e-b927-18bb558b79ce"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:28.072816 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-ee4d6739-742c-49dd-a84f-ffcf59828898 req-ed28991a-ea13-443f-99aa-2b6e83f5e4c7 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:28.074075 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-ee4d6739-742c-49dd-a84f-ffcf59828898 req-ed28991a-ea13-443f-99aa-2b6e83f5e4c7 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:28.102706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-ee4d6739-742c-49dd-a84f-ffcf59828898 req-ed28991a-ea13-443f-99aa-2b6e83f5e4c7 service nova] Creating event network-changed:b41d02f4-ab49-441e-b927-18bb558b79ce for instance c9563934-7879-4c30-8ae5-53605ba0b017 on hv-cinder-78836 May 26 15:17:28.109694 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-ee4d6739-742c-49dd-a84f-ffcf59828898 req-ed28991a-ea13-443f-99aa-2b6e83f5e4c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065991 May 26 15:17:28.110413 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 520/1015] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:17:28.421273 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-d7451c76-1bd5-4e39-a575-e6f1a9b018fb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:28.446646 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-d7451c76-1bd5-4e39-a575-e6f1a9b018fb tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1642 microversion: 2.1 time: 0.481850 May 26 15:17:28.448638 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 496/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:27 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1642 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:17:29.061090 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:29.062475 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:29.075467 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:29.076080 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:29.077375 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:29.078076 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:29.132659 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:29.133050 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:29.133534 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lazy-loading 'fault' on Instance uuid 6a80f2c7-1451-47b7-9f5e-3d53c21794ae {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:17:29.272256 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4afc097467f4c26a6d4da0e48b8303f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5cd1d25e6146bd93bd90286f668b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:17:29.286514 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d952a44f-56d6-4f11-a6d6-86b681b02f45 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 200 len: 1387 microversion: 2.1 time: 0.229940 May 26 15:17:29.299201 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 521/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:29 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 1387 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:17:30.312380 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:30.315607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] [instance: 6a80f2c7-1451-47b7-9f5e-3d53c21794ae] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:17:30.335599 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:30.337095 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:30.338777 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:17:30.339570 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:17:30.375646 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] HTTP exception thrown: Instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae could not be found. May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Request method failure captured: May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae HTTP/1.1 May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5i0vkgrnwGlaNbPsNSxEkBwb5Dw-LIApS75gjKw2OWLSVY96zrj5a9Npx7oFglWuy_E3c_EI59ciWR1NgxuVCPOMGQvEFL7B1n2YBOeS06wAqhSjxCcVj3oRS6fhgR8vqgZTnpxcjVkzC7BpcXHlSb8H1QRbaWt2T1cFHAeFfyaeGs May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 9c5cd1d25e6146bd93bd90286f668b9d May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-TestShelveInstance-1774837301 May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:17:30.379672 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c5cd1d25e6146bd93bd90286f668b9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c5cd1d25e6146bd93bd90286f668b9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c5cd1d25e6146bd93bd90286f668b9d", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c5cd1d25e6146bd93bd90286f668b9d"}]}] May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-TestShelveInstance-1774837301 May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 9c5cd1d25e6146bd93bd90286f668b9d May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-TestShelveInstance-1774837301 May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-TestShelveInstance-1774837301-project May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: e4afc097467f4c26a6d4da0e48b8303f May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-TestShelveInstance-1774837301-project May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae could not be found. May 26 15:17:30.381099 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '6a80f2c7-1451-47b7-9f5e-3d53c21794ae'} May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae could not be found. May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:17:30.382064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae could not be found. May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae could not be found. May 26 15:17:30.383366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:17:30.384838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Returning 404 to user: Instance 6a80f2c7-1451-47b7-9f5e-3d53c21794ae could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:17:30.384838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6323c2ce-ac3f-490a-a5c6-91c991446e2f tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae" status: 404 len: 111 microversion: 2.1 time: 0.080642 May 26 15:17:30.389852 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 497/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:17:30 2022] GET /compute/v2.1/servers/6a80f2c7-1451-47b7-9f5e-3d53c21794ae => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:17:30.692307 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0f5e4bf0-7e71-4f0b-81ba-0fcd9accc427 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] Calling method '.version_select at 0x7ff9669f6940>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:17:30.728211 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0f5e4bf0-7e71-4f0b-81ba-0fcd9accc427 tempest-TestShelveInstance-1774837301 tempest-TestShelveInstance-1774837301-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2104449665" status: 202 len: 0 microversion: 2.1 time: 0.040699 May 26 15:17:30.732923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 522/1019] 10.222.0.46 () {58 vars in 1253 bytes} [Thu May 26 15:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2104449665 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:17:46.861946 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:46.863245 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:17:47.121591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b4fdb509-cf7a-4269-943b-53d2e3671ec0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Action: 'create', calling method: .version_select at 0x7ff9658189d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-690201950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkIltpC4y1enoZzNcEXoS0iQlpIN4+X3TXwjfZVve9d62QrKKeVKgGveDkJcctH4xyyqdgUb3IKxKt03EcKXCpp75l6/4WeCIzmU6n0TPIHSe3dh7dgwyodVg59rKOrUw=="}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:17:47.139738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-b4fdb509-cf7a-4269-943b-53d2e3671ec0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Getting quotas for project 0b161426dbdc44ff8e52676e1bc21558. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:17:47.144807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-b4fdb509-cf7a-4269-943b-53d2e3671ec0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Getting quotas for user 176fec434836494a9af12c96be3a8eb0 and project 0b161426dbdc44ff8e52676e1bc21558. Resources: {'key_pairs'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:17:47.171329 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b4fdb509-cf7a-4269-943b-53d2e3671ec0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.314876 May 26 15:17:47.171995 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 498/1020] 10.222.0.46 () {60 vars in 1158 bytes} [Thu May 26 15:17:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:03.836561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=33 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:03.838657 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:03.855452 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3f8b771b-cd33-40b3-bd1b-a8165c2d04f7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:03.856577 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3f8b771b-cd33-40b3-bd1b-a8165c2d04f7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:03.865706 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f8b771b-cd33-40b3-bd1b-a8165c2d04f7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:03.866170 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f8b771b-cd33-40b3-bd1b-a8165c2d04f7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:03.866984 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f8b771b-cd33-40b3-bd1b-a8165c2d04f7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:03.867429 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3f8b771b-cd33-40b3-bd1b-a8165c2d04f7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:03.972547 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3f8b771b-cd33-40b3-bd1b-a8165c2d04f7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "POST /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/action" status: 202 len: 0 microversion: 2.1 time: 0.137873 May 26 15:18:03.973383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 523/1021] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:18:03 2022] POST /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:18:03.980595 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=4 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:03.981962 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:03.987384 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-a3de6617-aa94-47f5-8d0a-a2344e2bbcd2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:03.988051 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-a3de6617-aa94-47f5-8d0a-a2344e2bbcd2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:03.997706 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a3de6617-aa94-47f5-8d0a-a2344e2bbcd2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:03.998286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a3de6617-aa94-47f5-8d0a-a2344e2bbcd2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:03.998931 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a3de6617-aa94-47f5-8d0a-a2344e2bbcd2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:03.999370 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-a3de6617-aa94-47f5-8d0a-a2344e2bbcd2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:04.277166 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-a3de6617-aa94-47f5-8d0a-a2344e2bbcd2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:04.286990 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-a3de6617-aa94-47f5-8d0a-a2344e2bbcd2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1753 microversion: 2.1 time: 0.307776 May 26 15:18:04.287907 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 499/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:03 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1753 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:05.066218 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2012039623", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-690201950", "security_groups": [{"name": "tempest-secgroup-smoke-1286731114"}], "block_device_mapping_v2": [{"uuid": "0c28ae84-4e9a-4271-9d2f-5ba577ce14a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "17e8e6f7-36ad-4695-9496-110a02e0acc3"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:05.183967 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] validate_networks() for [('17e8e6f7-36ad-4695-9496-110a02e0acc3', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:18:05.308909 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-95af3aaa-641b-4caf-b5e3-abd281b5bca7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:05.309812 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-95af3aaa-641b-4caf-b5e3-abd281b5bca7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:05.317773 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95af3aaa-641b-4caf-b5e3-abd281b5bca7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.318458 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95af3aaa-641b-4caf-b5e3-abd281b5bca7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.319016 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95af3aaa-641b-4caf-b5e3-abd281b5bca7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.319453 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-95af3aaa-641b-4caf-b5e3-abd281b5bca7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.580528 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-95af3aaa-641b-4caf-b5e3-abd281b5bca7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:05.600085 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-95af3aaa-641b-4caf-b5e3-abd281b5bca7 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.294180 May 26 15:18:05.602333 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 500/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:05 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:05.941428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:18:05.941910 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:18:05.942996 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:18:05.943404 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:18:05.943817 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:18:05.953126 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.953671 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.954960 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:05.955378 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:05.973490 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Getting quotas for project 0b161426dbdc44ff8e52676e1bc21558. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:18:05.977687 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Getting quotas for user 176fec434836494a9af12c96be3a8eb0 and project 0b161426dbdc44ff8e52676e1bc21558. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:18:06.040154 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:18:06.042404 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c28ae84-4e9a-4271-9d2f-5ba577ce14a8',volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:18:06.181181 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cb61bcf2-d782-407d-a049-347c6654978b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.119451 May 26 15:18:06.182067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 524/1024] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:18:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:18:06.192119 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c8c2410f-764b-4308-83a3-de41d7f91f17 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:06.193444 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c8c2410f-764b-4308-83a3-de41d7f91f17 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:06.249127 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c8c2410f-764b-4308-83a3-de41d7f91f17 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:06.256585 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c8c2410f-764b-4308-83a3-de41d7f91f17 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1094 microversion: 2.1 time: 0.068571 May 26 15:18:06.257245 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 501/1025] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:06 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:06.620098 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-35eebfdb-e6ff-4296-a68e-47bc274998c1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:06.620739 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-35eebfdb-e6ff-4296-a68e-47bc274998c1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:06.628738 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35eebfdb-e6ff-4296-a68e-47bc274998c1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:06.629195 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35eebfdb-e6ff-4296-a68e-47bc274998c1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:06.630019 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35eebfdb-e6ff-4296-a68e-47bc274998c1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:06.630453 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-35eebfdb-e6ff-4296-a68e-47bc274998c1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:06.789332 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-35eebfdb-e6ff-4296-a68e-47bc274998c1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:06.800532 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-35eebfdb-e6ff-4296-a68e-47bc274998c1 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.184283 May 26 15:18:06.801116 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 525/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:06 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:07.275744 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f642beb4-4462-4d25-a493-53b2606e1218 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:07.276544 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f642beb4-4462-4d25-a493-53b2606e1218 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:07.333699 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f642beb4-4462-4d25-a493-53b2606e1218 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:07.344452 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f642beb4-4462-4d25-a493-53b2606e1218 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1094 microversion: 2.1 time: 0.072661 May 26 15:18:07.345092 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 502/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:07 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:07.819849 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-eb8f0a2e-c4a4-47ae-9cfb-57b739091a44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:07.820622 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-eb8f0a2e-c4a4-47ae-9cfb-57b739091a44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:07.827587 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eb8f0a2e-c4a4-47ae-9cfb-57b739091a44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:07.828036 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eb8f0a2e-c4a4-47ae-9cfb-57b739091a44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:07.828813 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eb8f0a2e-c4a4-47ae-9cfb-57b739091a44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:07.829284 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-eb8f0a2e-c4a4-47ae-9cfb-57b739091a44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:07.986950 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-eb8f0a2e-c4a4-47ae-9cfb-57b739091a44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:07.996419 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-eb8f0a2e-c4a4-47ae-9cfb-57b739091a44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.181117 May 26 15:18:07.996995 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 526/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:07 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:08.361029 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-833520a4-22fd-425f-a6b1-5882fc8181d7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:08.361687 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-833520a4-22fd-425f-a6b1-5882fc8181d7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:08.425351 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-833520a4-22fd-425f-a6b1-5882fc8181d7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:08.437546 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-833520a4-22fd-425f-a6b1-5882fc8181d7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1094 microversion: 2.1 time: 0.079843 May 26 15:18:08.438586 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 503/1029] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:08 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:09.013676 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-d172f6b2-0cd2-44aa-975d-e705efdbeb75 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:09.014328 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-d172f6b2-0cd2-44aa-975d-e705efdbeb75 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:09.021120 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d172f6b2-0cd2-44aa-975d-e705efdbeb75 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:09.021581 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d172f6b2-0cd2-44aa-975d-e705efdbeb75 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:09.022410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d172f6b2-0cd2-44aa-975d-e705efdbeb75 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:09.022913 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-d172f6b2-0cd2-44aa-975d-e705efdbeb75 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:09.173038 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-d172f6b2-0cd2-44aa-975d-e705efdbeb75 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:09.182243 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-d172f6b2-0cd2-44aa-975d-e705efdbeb75 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.172357 May 26 15:18:09.182832 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 527/1030] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:09 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:09.461933 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-20fb0862-1c07-4bc4-b841-f4f83929bd80 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:09.462554 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-20fb0862-1c07-4bc4-b841-f4f83929bd80 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:09.522110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-20fb0862-1c07-4bc4-b841-f4f83929bd80 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:09.528907 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-20fb0862-1c07-4bc4-b841-f4f83929bd80 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1094 microversion: 2.1 time: 0.070868 May 26 15:18:09.529496 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 504/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:09 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:10.200175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a76a67a0-3616-48ec-8db4-ee79aae695d2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:10.200879 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a76a67a0-3616-48ec-8db4-ee79aae695d2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:10.208454 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a76a67a0-3616-48ec-8db4-ee79aae695d2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:10.208906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a76a67a0-3616-48ec-8db4-ee79aae695d2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:10.209717 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a76a67a0-3616-48ec-8db4-ee79aae695d2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:10.210159 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a76a67a0-3616-48ec-8db4-ee79aae695d2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:10.369663 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a76a67a0-3616-48ec-8db4-ee79aae695d2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:10.377804 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a76a67a0-3616-48ec-8db4-ee79aae695d2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.181833 May 26 15:18:10.378381 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 528/1032] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:10 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:10.547939 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-655a7e65-13a6-4af0-aea4-01fdfc7b13c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:10.548627 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-655a7e65-13a6-4af0-aea4-01fdfc7b13c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:10.555779 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-655a7e65-13a6-4af0-aea4-01fdfc7b13c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:10.556230 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-655a7e65-13a6-4af0-aea4-01fdfc7b13c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:10.557000 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-655a7e65-13a6-4af0-aea4-01fdfc7b13c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:10.557439 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-655a7e65-13a6-4af0-aea4-01fdfc7b13c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:10.634345 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-655a7e65-13a6-4af0-aea4-01fdfc7b13c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:10.644512 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-655a7e65-13a6-4af0-aea4-01fdfc7b13c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1144 microversion: 2.1 time: 0.100911 May 26 15:18:10.647408 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 505/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:10 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1144 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:11.394528 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-8c4fe354-580d-4391-b40b-ce5f121adb7e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:11.396381 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-8c4fe354-580d-4391-b40b-ce5f121adb7e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:11.403598 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c4fe354-580d-4391-b40b-ce5f121adb7e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:11.404059 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c4fe354-580d-4391-b40b-ce5f121adb7e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:11.404850 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c4fe354-580d-4391-b40b-ce5f121adb7e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:11.405295 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-8c4fe354-580d-4391-b40b-ce5f121adb7e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:11.663447 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-123c6acb-54b4-49d2-9946-adc843355dbb tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:11.664211 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-123c6acb-54b4-49d2-9946-adc843355dbb tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:11.671091 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-123c6acb-54b4-49d2-9946-adc843355dbb tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:11.671676 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-123c6acb-54b4-49d2-9946-adc843355dbb tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:11.672515 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-123c6acb-54b4-49d2-9946-adc843355dbb tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:11.673130 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-123c6acb-54b4-49d2-9946-adc843355dbb tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:11.699516 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-8c4fe354-580d-4391-b40b-ce5f121adb7e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:11.726399 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-8c4fe354-580d-4391-b40b-ce5f121adb7e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.335409 May 26 15:18:11.738354 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 529/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:11 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:11.782531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-123c6acb-54b4-49d2-9946-adc843355dbb tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:11.791185 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-123c6acb-54b4-49d2-9946-adc843355dbb tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1210 microversion: 2.1 time: 0.131639 May 26 15:18:11.791844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 506/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:11 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:12.746563 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-bf6217e1-f245-405e-b029-8eb9e88ad189 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:12.747181 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-bf6217e1-f245-405e-b029-8eb9e88ad189 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:12.754105 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bf6217e1-f245-405e-b029-8eb9e88ad189 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:12.755528 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bf6217e1-f245-405e-b029-8eb9e88ad189 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:12.756817 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bf6217e1-f245-405e-b029-8eb9e88ad189 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:12.757263 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-bf6217e1-f245-405e-b029-8eb9e88ad189 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:12.810535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ec79c1d2-72b5-4f9a-adbd-61f4b8e7673c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:12.812101 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ec79c1d2-72b5-4f9a-adbd-61f4b8e7673c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:12.821887 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ec79c1d2-72b5-4f9a-adbd-61f4b8e7673c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:12.822928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ec79c1d2-72b5-4f9a-adbd-61f4b8e7673c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:12.824059 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ec79c1d2-72b5-4f9a-adbd-61f4b8e7673c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:12.825072 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ec79c1d2-72b5-4f9a-adbd-61f4b8e7673c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:13.138648 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-bf6217e1-f245-405e-b029-8eb9e88ad189 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:13.142922 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ec79c1d2-72b5-4f9a-adbd-61f4b8e7673c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:13.153206 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ec79c1d2-72b5-4f9a-adbd-61f4b8e7673c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.347836 May 26 15:18:13.155270 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-bf6217e1-f245-405e-b029-8eb9e88ad189 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.412920 May 26 15:18:13.159888 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 507/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:12 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:13.166575 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 530/1037] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:12 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:13.358930 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-45b8a859-e9f2-46b1-815c-e9222392ed2d req-2e8cc0bc-6129-4e90-9727-249eba9a0ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede26c84-934a-4de5-825c-00e32c8c37a8", "tag": "0bfb8228-ae03-42e8-a883-76fd82ef87da"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:13.386878 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-45b8a859-e9f2-46b1-815c-e9222392ed2d req-2e8cc0bc-6129-4e90-9727-249eba9a0ff2 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:13.387688 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-45b8a859-e9f2-46b1-815c-e9222392ed2d req-2e8cc0bc-6129-4e90-9727-249eba9a0ff2 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:13.405709 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-45b8a859-e9f2-46b1-815c-e9222392ed2d req-2e8cc0bc-6129-4e90-9727-249eba9a0ff2 service nova] Creating event network-changed:0bfb8228-ae03-42e8-a883-76fd82ef87da for instance ede26c84-934a-4de5-825c-00e32c8c37a8 on hv-cinder-78836 May 26 15:18:13.412927 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-45b8a859-e9f2-46b1-815c-e9222392ed2d req-2e8cc0bc-6129-4e90-9727-249eba9a0ff2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058880 May 26 15:18:13.415325 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 508/1038] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:14.173428 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f733a098-8661-4aef-a945-d316919e7f44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:14.174325 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f733a098-8661-4aef-a945-d316919e7f44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:14.183903 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0f4d9a10-144f-4f83-b460-a4416c8ac4b7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:14.184544 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f733a098-8661-4aef-a945-d316919e7f44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:14.184643 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0f4d9a10-144f-4f83-b460-a4416c8ac4b7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:14.185235 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f733a098-8661-4aef-a945-d316919e7f44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:14.186472 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f733a098-8661-4aef-a945-d316919e7f44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:14.187348 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f733a098-8661-4aef-a945-d316919e7f44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:14.203179 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f4d9a10-144f-4f83-b460-a4416c8ac4b7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:14.204015 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f4d9a10-144f-4f83-b460-a4416c8ac4b7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:14.205102 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f4d9a10-144f-4f83-b460-a4416c8ac4b7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:14.205895 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-0f4d9a10-144f-4f83-b460-a4416c8ac4b7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:14.517748 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0f4d9a10-144f-4f83-b460-a4416c8ac4b7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:14.526422 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0f4d9a10-144f-4f83-b460-a4416c8ac4b7 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.353945 May 26 15:18:14.527018 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 509/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:14 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:18:14.564446 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f733a098-8661-4aef-a945-d316919e7f44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:14.573615 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f733a098-8661-4aef-a945-d316919e7f44 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.404022 May 26 15:18:14.574199 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 531/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:14 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:15.544170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-044eb2ca-9496-4ea1-a028-82b458a1e052 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:15.544780 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-044eb2ca-9496-4ea1-a028-82b458a1e052 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:15.551438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-044eb2ca-9496-4ea1-a028-82b458a1e052 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:15.551892 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-044eb2ca-9496-4ea1-a028-82b458a1e052 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:15.552659 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-044eb2ca-9496-4ea1-a028-82b458a1e052 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:15.553085 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-044eb2ca-9496-4ea1-a028-82b458a1e052 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:15.593322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-46749342-6e6a-46ad-a644-da0e381fcbef tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:15.593972 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-46749342-6e6a-46ad-a644-da0e381fcbef tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:15.601023 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-46749342-6e6a-46ad-a644-da0e381fcbef tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:15.601485 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-46749342-6e6a-46ad-a644-da0e381fcbef tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:15.602664 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-46749342-6e6a-46ad-a644-da0e381fcbef tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:15.603299 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-46749342-6e6a-46ad-a644-da0e381fcbef tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:15.755186 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-044eb2ca-9496-4ea1-a028-82b458a1e052 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:15.763753 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-044eb2ca-9496-4ea1-a028-82b458a1e052 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.223351 May 26 15:18:15.764347 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 510/1041] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:15 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:15.798716 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-46749342-6e6a-46ad-a644-da0e381fcbef tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:15.807497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-46749342-6e6a-46ad-a644-da0e381fcbef tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1758 microversion: 2.1 time: 0.218660 May 26 15:18:15.808088 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 532/1042] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:15 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1758 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:18:16.780645 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e3b2aff5-3638-4ce3-896a-b28143fab636 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:16.781240 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e3b2aff5-3638-4ce3-896a-b28143fab636 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:16.788360 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3b2aff5-3638-4ce3-896a-b28143fab636 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:16.788799 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3b2aff5-3638-4ce3-896a-b28143fab636 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:16.789574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3b2aff5-3638-4ce3-896a-b28143fab636 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:16.790010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e3b2aff5-3638-4ce3-896a-b28143fab636 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:16.822544 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:16.823793 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:16.828646 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f85612c7-2747-445a-a8f8-b7850a3853a3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:16.829260 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f85612c7-2747-445a-a8f8-b7850a3853a3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:16.836961 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f85612c7-2747-445a-a8f8-b7850a3853a3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:16.837476 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f85612c7-2747-445a-a8f8-b7850a3853a3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:16.838228 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f85612c7-2747-445a-a8f8-b7850a3853a3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:16.841272 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f85612c7-2747-445a-a8f8-b7850a3853a3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:17.002540 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e3b2aff5-3638-4ce3-896a-b28143fab636 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:17.014866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e3b2aff5-3638-4ce3-896a-b28143fab636 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.237869 May 26 15:18:17.015813 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 511/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:16 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:17.042997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f85612c7-2747-445a-a8f8-b7850a3853a3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:17.051363 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f85612c7-2747-445a-a8f8-b7850a3853a3 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1761 microversion: 2.1 time: 0.229774 May 26 15:18:17.051939 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 533/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:16 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1761 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:18:18.036178 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-faf098aa-2021-4942-abf5-32a657d5729b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:18.036932 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-faf098aa-2021-4942-abf5-32a657d5729b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:18.043623 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-faf098aa-2021-4942-abf5-32a657d5729b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:18.044378 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-faf098aa-2021-4942-abf5-32a657d5729b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:18.045421 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-faf098aa-2021-4942-abf5-32a657d5729b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:18.045902 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-faf098aa-2021-4942-abf5-32a657d5729b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:18.185061 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-faf098aa-2021-4942-abf5-32a657d5729b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:18.192847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-faf098aa-2021-4942-abf5-32a657d5729b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.161081 May 26 15:18:18.193429 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 512/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:18 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:19.211173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-494c9ff5-8a62-4fda-9643-168a4b43a6c0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:19.211173 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-494c9ff5-8a62-4fda-9643-168a4b43a6c0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:19.218389 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-494c9ff5-8a62-4fda-9643-168a4b43a6c0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:19.218847 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-494c9ff5-8a62-4fda-9643-168a4b43a6c0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:19.219630 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-494c9ff5-8a62-4fda-9643-168a4b43a6c0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:19.220069 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-494c9ff5-8a62-4fda-9643-168a4b43a6c0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:19.361027 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-494c9ff5-8a62-4fda-9643-168a4b43a6c0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:19.369763 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-494c9ff5-8a62-4fda-9643-168a4b43a6c0 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.164098 May 26 15:18:19.370336 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 534/1046] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:19 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:20.388671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-486aa8d8-937a-4f23-84c4-06e759c2c2fc tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:20.389289 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-486aa8d8-937a-4f23-84c4-06e759c2c2fc tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:20.391483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=8 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:20.397702 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-486aa8d8-937a-4f23-84c4-06e759c2c2fc tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:20.398180 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-486aa8d8-937a-4f23-84c4-06e759c2c2fc tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:20.398957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-486aa8d8-937a-4f23-84c4-06e759c2c2fc tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:20.399396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-486aa8d8-937a-4f23-84c4-06e759c2c2fc tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:20.542339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-486aa8d8-937a-4f23-84c4-06e759c2c2fc tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:20.549910 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-486aa8d8-937a-4f23-84c4-06e759c2c2fc tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.165115 May 26 15:18:20.550490 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 513/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:20 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:21.567248 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-702ee235-5182-4689-bd97-77b32c80ef9d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:21.567846 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-702ee235-5182-4689-bd97-77b32c80ef9d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:21.574680 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-702ee235-5182-4689-bd97-77b32c80ef9d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:21.575143 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-702ee235-5182-4689-bd97-77b32c80ef9d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:21.575931 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-702ee235-5182-4689-bd97-77b32c80ef9d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:21.576375 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-702ee235-5182-4689-bd97-77b32c80ef9d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:21.713997 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-702ee235-5182-4689-bd97-77b32c80ef9d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:21.721859 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-702ee235-5182-4689-bd97-77b32c80ef9d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.158516 May 26 15:18:21.722476 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 535/1048] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:21 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:22.740822 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-1c4e714c-0bc2-4e11-b640-340298fb059f tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:22.741676 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-1c4e714c-0bc2-4e11-b640-340298fb059f tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:22.748681 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1c4e714c-0bc2-4e11-b640-340298fb059f tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:22.749125 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1c4e714c-0bc2-4e11-b640-340298fb059f tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:22.749928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1c4e714c-0bc2-4e11-b640-340298fb059f tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:22.750356 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-1c4e714c-0bc2-4e11-b640-340298fb059f tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:22.892936 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-1c4e714c-0bc2-4e11-b640-340298fb059f tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:22.900623 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-1c4e714c-0bc2-4e11-b640-340298fb059f tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.164389 May 26 15:18:22.901196 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 514/1049] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:22 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:23.919717 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0ec3cff1-ee88-4d8e-8df4-5e8a25a6d379 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:23.920362 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0ec3cff1-ee88-4d8e-8df4-5e8a25a6d379 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:23.928034 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0ec3cff1-ee88-4d8e-8df4-5e8a25a6d379 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:23.928545 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0ec3cff1-ee88-4d8e-8df4-5e8a25a6d379 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:23.929335 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0ec3cff1-ee88-4d8e-8df4-5e8a25a6d379 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:23.929821 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0ec3cff1-ee88-4d8e-8df4-5e8a25a6d379 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:24.027835 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-d330354e-fc8e-4b2e-9ea1-1516dd2a4359 req-c6e08987-f937-4f3a-8943-b74c8399b57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede26c84-934a-4de5-825c-00e32c8c37a8", "name": "network-vif-plugged", "status": "completed", "tag": "0bfb8228-ae03-42e8-a883-76fd82ef87da"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:24.038681 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-d330354e-fc8e-4b2e-9ea1-1516dd2a4359 req-c6e08987-f937-4f3a-8943-b74c8399b57e service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:24.039216 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-d330354e-fc8e-4b2e-9ea1-1516dd2a4359 req-c6e08987-f937-4f3a-8943-b74c8399b57e service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:24.051660 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-d330354e-fc8e-4b2e-9ea1-1516dd2a4359 req-c6e08987-f937-4f3a-8943-b74c8399b57e service nova] Creating event network-vif-plugged:0bfb8228-ae03-42e8-a883-76fd82ef87da for instance ede26c84-934a-4de5-825c-00e32c8c37a8 on hv-cinder-78836 May 26 15:18:24.057377 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-d330354e-fc8e-4b2e-9ea1-1516dd2a4359 req-c6e08987-f937-4f3a-8943-b74c8399b57e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 May 26 15:18:24.058256 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 515/1050] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:24.078447 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0ec3cff1-ee88-4d8e-8df4-5e8a25a6d379 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:24.087225 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0ec3cff1-ee88-4d8e-8df4-5e8a25a6d379 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.171122 May 26 15:18:24.087823 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 536/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:23 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:25.106006 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b29c93c6-88e8-45c7-9ad6-e149cb51643b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:25.106710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b29c93c6-88e8-45c7-9ad6-e149cb51643b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:25.112988 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b29c93c6-88e8-45c7-9ad6-e149cb51643b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.113439 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b29c93c6-88e8-45c7-9ad6-e149cb51643b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.115114 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b29c93c6-88e8-45c7-9ad6-e149cb51643b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:25.115556 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b29c93c6-88e8-45c7-9ad6-e149cb51643b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:25.256783 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-b29c93c6-88e8-45c7-9ad6-e149cb51643b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:25.264892 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b29c93c6-88e8-45c7-9ad6-e149cb51643b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1266 microversion: 2.1 time: 0.163551 May 26 15:18:25.265634 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 516/1052] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:25 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:26.281558 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-590eda42-c34e-4818-9b1f-c3d57eb42752 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:26.282183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-590eda42-c34e-4818-9b1f-c3d57eb42752 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:26.290130 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-590eda42-c34e-4818-9b1f-c3d57eb42752 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:26.290695 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-590eda42-c34e-4818-9b1f-c3d57eb42752 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:26.291387 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-590eda42-c34e-4818-9b1f-c3d57eb42752 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:26.291830 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-590eda42-c34e-4818-9b1f-c3d57eb42752 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:26.437274 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-590eda42-c34e-4818-9b1f-c3d57eb42752 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:26.445727 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-590eda42-c34e-4818-9b1f-c3d57eb42752 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1453 microversion: 2.1 time: 0.167874 May 26 15:18:26.446420 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 537/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:26 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:26.464086 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f90e54f6-a9f8-413e-9990-fe8fb65afb77 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:26.464944 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f90e54f6-a9f8-413e-9990-fe8fb65afb77 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:26.473069 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f90e54f6-a9f8-413e-9990-fe8fb65afb77 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:26.473558 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f90e54f6-a9f8-413e-9990-fe8fb65afb77 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:26.474350 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f90e54f6-a9f8-413e-9990-fe8fb65afb77 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:26.474788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f90e54f6-a9f8-413e-9990-fe8fb65afb77 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:26.616157 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f90e54f6-a9f8-413e-9990-fe8fb65afb77 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:26.625437 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f90e54f6-a9f8-413e-9990-fe8fb65afb77 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1453 microversion: 2.1 time: 0.166297 May 26 15:18:26.626053 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 517/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:26 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:28.871240 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-39729f10-6210-4b84-bd6e-3e26732ef66f req-393f6e35-2c75-42f0-83e7-8c3c0145b1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede26c84-934a-4de5-825c-00e32c8c37a8", "tag": "0bfb8228-ae03-42e8-a883-76fd82ef87da"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:28.881284 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-39729f10-6210-4b84-bd6e-3e26732ef66f req-393f6e35-2c75-42f0-83e7-8c3c0145b1da service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:28.881767 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-39729f10-6210-4b84-bd6e-3e26732ef66f req-393f6e35-2c75-42f0-83e7-8c3c0145b1da service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:28.896955 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-39729f10-6210-4b84-bd6e-3e26732ef66f req-393f6e35-2c75-42f0-83e7-8c3c0145b1da service nova] Creating event network-changed:0bfb8228-ae03-42e8-a883-76fd82ef87da for instance ede26c84-934a-4de5-825c-00e32c8c37a8 on hv-cinder-78836 May 26 15:18:28.903151 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-39729f10-6210-4b84-bd6e-3e26732ef66f req-393f6e35-2c75-42f0-83e7-8c3c0145b1da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035788 May 26 15:18:28.903761 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 538/1055] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:49.495859 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-15fc925c-1816-456b-9cdc-d59cba7ed9c5 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-791974402"}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:49.496495 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-15fc925c-1816-456b-9cdc-d59cba7ed9c5 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:49.498641 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=46 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:49.499306 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=82 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:49.505053 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-15fc925c-1816-456b-9cdc-d59cba7ed9c5 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:49.505551 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-15fc925c-1816-456b-9cdc-d59cba7ed9c5 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:49.506318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-15fc925c-1816-456b-9cdc-d59cba7ed9c5 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:49.506752 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-15fc925c-1816-456b-9cdc-d59cba7ed9c5 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:49.770003 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.network.security_group_api [None req-15fc925c-1816-456b-9cdc-d59cba7ed9c5 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Removing security group 92072407-b5c0-4931-ab59-d0a3a5bfc720 from port b41d02f4-ab49-441e-b927-18bb558b79ce May 26 15:18:50.176442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-15fc925c-1816-456b-9cdc-d59cba7ed9c5 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "POST /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/action" status: 202 len: 0 microversion: 2.1 time: 0.680634 May 26 15:18:50.176442 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 518/1056] 10.222.0.46 () {60 vars in 1277 bytes} [Thu May 26 15:18:49 2022] POST /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:18:50.185684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-808aa0b2-97bc-4b99-85f8-c7d75407a6aa req-543b6442-d693-4149-81fe-d2d7b6b9053f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9563934-7879-4c30-8ae5-53605ba0b017", "tag": "b41d02f4-ab49-441e-b927-18bb558b79ce"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:50.197487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:50.198254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:18:50.207916 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-808aa0b2-97bc-4b99-85f8-c7d75407a6aa req-543b6442-d693-4149-81fe-d2d7b6b9053f service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:50.211701 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-808aa0b2-97bc-4b99-85f8-c7d75407a6aa req-543b6442-d693-4149-81fe-d2d7b6b9053f service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:50.232212 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-808aa0b2-97bc-4b99-85f8-c7d75407a6aa req-543b6442-d693-4149-81fe-d2d7b6b9053f service nova] Creating event network-changed:b41d02f4-ab49-441e-b927-18bb558b79ce for instance c9563934-7879-4c30-8ae5-53605ba0b017 on hv-cinder-78836 May 26 15:18:50.244205 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-808aa0b2-97bc-4b99-85f8-c7d75407a6aa req-543b6442-d693-4149-81fe-d2d7b6b9053f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063323 May 26 15:18:50.244835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 539/1057] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:51.905845 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-b79805d2-9be8-435e-8983-ae72c42b7206 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:51.906561 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-b79805d2-9be8-435e-8983-ae72c42b7206 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:51.912803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b79805d2-9be8-435e-8983-ae72c42b7206 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:51.913961 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b79805d2-9be8-435e-8983-ae72c42b7206 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:51.915299 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b79805d2-9be8-435e-8983-ae72c42b7206 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:51.915887 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-b79805d2-9be8-435e-8983-ae72c42b7206 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:52.015336 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.objects.instance [None req-b79805d2-9be8-435e-8983-ae72c42b7206 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lazy-loading 'services' on Instance uuid c9563934-7879-4c30-8ae5-53605ba0b017 {{(pid=117724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:18:52.102316 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-b79805d2-9be8-435e-8983-ae72c42b7206 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments/56826227-5d7b-4c8e-8b8a-ec16ccd19e59" status: 202 len: 0 microversion: 2.1 time: 0.200567 May 26 15:18:52.102905 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 519/1058] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:18:51 2022] DELETE /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments/56826227-5d7b-4c8e-8b8a-ec16ccd19e59 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:18:52.114702 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-7a85d802-2c79-49c3-9c4a-8084d2eac805 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:52.116820 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-7a85d802-2c79-49c3-9c4a-8084d2eac805 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:52.123654 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7a85d802-2c79-49c3-9c4a-8084d2eac805 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:52.124124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7a85d802-2c79-49c3-9c4a-8084d2eac805 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:52.125014 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7a85d802-2c79-49c3-9c4a-8084d2eac805 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:52.125561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-7a85d802-2c79-49c3-9c4a-8084d2eac805 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:52.165113 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-7a85d802-2c79-49c3-9c4a-8084d2eac805 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057178 May 26 15:18:52.173046 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 540/1059] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:18:52 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:52.259669 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-06d8d432-8447-4c3a-b994-fb59233cb15e req-55dc2be0-6e0c-4b73-972b-b0ae76d747ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9563934-7879-4c30-8ae5-53605ba0b017", "tag": "b41d02f4-ab49-441e-b927-18bb558b79ce"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:52.268258 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-06d8d432-8447-4c3a-b994-fb59233cb15e req-55dc2be0-6e0c-4b73-972b-b0ae76d747ab service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:52.268697 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-06d8d432-8447-4c3a-b994-fb59233cb15e req-55dc2be0-6e0c-4b73-972b-b0ae76d747ab service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:52.280677 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-06d8d432-8447-4c3a-b994-fb59233cb15e req-55dc2be0-6e0c-4b73-972b-b0ae76d747ab service nova] Creating event network-changed:b41d02f4-ab49-441e-b927-18bb558b79ce for instance c9563934-7879-4c30-8ae5-53605ba0b017 on hv-cinder-78836 May 26 15:18:52.285916 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-06d8d432-8447-4c3a-b994-fb59233cb15e req-55dc2be0-6e0c-4b73-972b-b0ae76d747ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030946 May 26 15:18:52.286527 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 520/1060] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:53.180995 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3efd1e93-34c8-4321-9f8b-b9ad569c9496 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:53.182078 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3efd1e93-34c8-4321-9f8b-b9ad569c9496 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:53.189061 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3efd1e93-34c8-4321-9f8b-b9ad569c9496 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:53.189555 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3efd1e93-34c8-4321-9f8b-b9ad569c9496 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:53.190423 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3efd1e93-34c8-4321-9f8b-b9ad569c9496 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:53.190787 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3efd1e93-34c8-4321-9f8b-b9ad569c9496 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:53.223426 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3efd1e93-34c8-4321-9f8b-b9ad569c9496 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046742 May 26 15:18:53.224017 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 541/1061] 10.222.0.46 () {58 vars in 1301 bytes} [Thu May 26 15:18:53 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:18:53.236097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:53.236736 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:53.243286 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:53.243733 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:53.244479 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:53.244912 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:53.332937 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] HTTP exception thrown: Instance c9563934-7879-4c30-8ae5-53605ba0b017 is not attached to volume 56826227-5d7b-4c8e-8b8a-ec16ccd19e59 May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Request method failure captured: May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: DELETE /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments/56826227-5d7b-4c8e-8b8a-ec16ccd19e59 HTTP/1.1 May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5nLIAgMJFD0E8NsX6IOwoPEGV3kzZs_HnK03CHUS-acejUwBzPLtf-brkOa5AAvJ7HhzeaTZyI0yBhoZF1J0_nNlcb2zQluNarolKGDcm6ijC9w9t5tXTfTL_gMLWMa_zMnPmO4pGGdSZMBxQy6n0J26Up7-zRFqhb5jnut0Crf590 May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: fb7e58e0c6954bb5ae0fafee4c7a6724 May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-TestMinimumBasicScenario-1560269162 May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:18:53.342339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb7e58e0c6954bb5ae0fafee4c7a6724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb7e58e0c6954bb5ae0fafee4c7a6724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fb7e58e0c6954bb5ae0fafee4c7a6724", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fb7e58e0c6954bb5ae0fafee4c7a6724"}]}] May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-TestMinimumBasicScenario-1560269162 May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: fb7e58e0c6954bb5ae0fafee4c7a6724 May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1560269162 May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-TestMinimumBasicScenario-1560269162-project May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: e6e2622df88f4e1b9b81097d6e558f21 May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-TestMinimumBasicScenario-1560269162-project May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:18:53.344438 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance c9563934-7879-4c30-8ae5-53605ba0b017 is not attached to volume 56826227-5d7b-4c8e-8b8a-ec16ccd19e59 May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'server_id': 'c9563934-7879-4c30-8ae5-53605ba0b017', 'id': '56826227-5d7b-4c8e-8b8a-ec16ccd19e59'} May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 56826227-5d7b-4c8e-8b8a-ec16ccd19e59. May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:18:53.345673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9563934-7879-4c30-8ae5-53605ba0b017 is not attached to volume 56826227-5d7b-4c8e-8b8a-ec16ccd19e59 May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9563934-7879-4c30-8ae5-53605ba0b017 is not attached to volume 56826227-5d7b-4c8e-8b8a-ec16ccd19e59 May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:53.347175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Returning 404 to user: Instance c9563934-7879-4c30-8ae5-53605ba0b017 is not attached to volume 56826227-5d7b-4c8e-8b8a-ec16ccd19e59 {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:18:53.348382 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-6de3d48d-381b-4715-8a82-59450761e9f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments/56826227-5d7b-4c8e-8b8a-ec16ccd19e59" status: 404 len: 154 microversion: 2.1 time: 0.112672 May 26 15:18:53.348382 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 521/1062] 10.222.0.46 () {58 vars in 1415 bytes} [Thu May 26 15:18:53 2022] DELETE /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017/os-volume_attachments/56826227-5d7b-4c8e-8b8a-ec16ccd19e59 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:18:54.492755 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-89f5e0e9-b30d-4d42-9caf-3af7137c1144 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:54.493296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-89f5e0e9-b30d-4d42-9caf-3af7137c1144 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:54.499806 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89f5e0e9-b30d-4d42-9caf-3af7137c1144 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:54.500249 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89f5e0e9-b30d-4d42-9caf-3af7137c1144 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:54.501025 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89f5e0e9-b30d-4d42-9caf-3af7137c1144 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:54.502101 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-89f5e0e9-b30d-4d42-9caf-3af7137c1144 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:54.530067 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-89f5e0e9-b30d-4d42-9caf-3af7137c1144 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:18:54.615628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-89f5e0e9-b30d-4d42-9caf-3af7137c1144 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 204 len: 0 microversion: 2.1 time: 0.126680 May 26 15:18:54.619923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 542/1063] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:18:54 2022] DELETE /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:18:54.625906 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-df1dbb9c-0003-4b3c-b769-9a31092df1f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:54.626635 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-df1dbb9c-0003-4b3c-b769-9a31092df1f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:54.634847 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-df1dbb9c-0003-4b3c-b769-9a31092df1f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:54.635296 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-df1dbb9c-0003-4b3c-b769-9a31092df1f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:54.636076 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-df1dbb9c-0003-4b3c-b769-9a31092df1f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:54.636515 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-df1dbb9c-0003-4b3c-b769-9a31092df1f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:54.777687 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-df1dbb9c-0003-4b3c-b769-9a31092df1f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:54.785743 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-df1dbb9c-0003-4b3c-b769-9a31092df1f2 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1556 microversion: 2.1 time: 0.163694 May 26 15:18:54.786575 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 522/1064] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:54 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:55.806343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b38c9a1a-58b3-4a75-9b02-919da58ec77e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:55.807082 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b38c9a1a-58b3-4a75-9b02-919da58ec77e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:55.814025 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b38c9a1a-58b3-4a75-9b02-919da58ec77e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:55.814471 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b38c9a1a-58b3-4a75-9b02-919da58ec77e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:55.815239 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b38c9a1a-58b3-4a75-9b02-919da58ec77e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:55.815669 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b38c9a1a-58b3-4a75-9b02-919da58ec77e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:56.017893 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b38c9a1a-58b3-4a75-9b02-919da58ec77e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:56.026913 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b38c9a1a-58b3-4a75-9b02-919da58ec77e tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1556 microversion: 2.1 time: 0.225243 May 26 15:18:56.027491 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 543/1065] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:55 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1556 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:56.996436 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-63dd74a7-b90a-44df-b777-5d3cc83d9702 req-b5cd33ba-eec5-4c68-a03a-c15009d53657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9563934-7879-4c30-8ae5-53605ba0b017", "name": "network-vif-deleted", "tag": "b41d02f4-ab49-441e-b927-18bb558b79ce"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:18:57.007179 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-63dd74a7-b90a-44df-b777-5d3cc83d9702 req-b5cd33ba-eec5-4c68-a03a-c15009d53657 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:57.007622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-63dd74a7-b90a-44df-b777-5d3cc83d9702 req-b5cd33ba-eec5-4c68-a03a-c15009d53657 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:57.019590 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-63dd74a7-b90a-44df-b777-5d3cc83d9702 req-b5cd33ba-eec5-4c68-a03a-c15009d53657 service nova] Creating event network-vif-deleted:b41d02f4-ab49-441e-b927-18bb558b79ce for instance c9563934-7879-4c30-8ae5-53605ba0b017 on hv-cinder-78836 May 26 15:18:57.024854 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-63dd74a7-b90a-44df-b777-5d3cc83d9702 req-b5cd33ba-eec5-4c68-a03a-c15009d53657 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 May 26 15:18:57.025503 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 523/1066] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:18:57.043374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-fe58ec03-45fa-4923-bbae-45874398a937 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:57.043976 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-fe58ec03-45fa-4923-bbae-45874398a937 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:57.050529 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe58ec03-45fa-4923-bbae-45874398a937 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:57.050981 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe58ec03-45fa-4923-bbae-45874398a937 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:57.052025 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe58ec03-45fa-4923-bbae-45874398a937 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:57.052714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-fe58ec03-45fa-4923-bbae-45874398a937 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:57.122530 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-fe58ec03-45fa-4923-bbae-45874398a937 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6e2622df88f4e1b9b81097d6e558f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb7e58e0c6954bb5ae0fafee4c7a6724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:18:57.130561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-fe58ec03-45fa-4923-bbae-45874398a937 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 200 len: 1344 microversion: 2.1 time: 0.091010 May 26 15:18:57.131148 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 544/1067] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:57 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 1344 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:18:58.150817 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:58.151542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] [instance: c9563934-7879-4c30-8ae5-53605ba0b017] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:18:58.159147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:58.159147 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:58.159597 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:18:58.160036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:18:58.174994 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] HTTP exception thrown: Instance c9563934-7879-4c30-8ae5-53605ba0b017 could not be found. May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Request method failure captured: May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 HTTP/1.1 May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5nLIAgMJFD0E8NsX6IOwoPEGV3kzZs_HnK03CHUS-acejUwBzPLtf-brkOa5AAvJ7HhzeaTZyI0yBhoZF1J0_nNlcb2zQluNarolKGDcm6ijC9w9t5tXTfTL_gMLWMa_zMnPmO4pGGdSZMBxQy6n0J26Up7-zRFqhb5jnut0Crf590 May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: fb7e58e0c6954bb5ae0fafee4c7a6724 May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-TestMinimumBasicScenario-1560269162 May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:18:58.176693 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb7e58e0c6954bb5ae0fafee4c7a6724"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fb7e58e0c6954bb5ae0fafee4c7a6724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fb7e58e0c6954bb5ae0fafee4c7a6724", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fb7e58e0c6954bb5ae0fafee4c7a6724"}]}] May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-TestMinimumBasicScenario-1560269162 May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: fb7e58e0c6954bb5ae0fafee4c7a6724 May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1560269162 May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-TestMinimumBasicScenario-1560269162-project May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: e6e2622df88f4e1b9b81097d6e558f21 May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-TestMinimumBasicScenario-1560269162-project May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance c9563934-7879-4c30-8ae5-53605ba0b017 could not be found. May 26 15:18:58.179173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': 'c9563934-7879-4c30-8ae5-53605ba0b017'} May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9563934-7879-4c30-8ae5-53605ba0b017 could not be found. May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:18:58.180531 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9563934-7879-4c30-8ae5-53605ba0b017 could not be found. May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9563934-7879-4c30-8ae5-53605ba0b017 could not be found. May 26 15:18:58.182975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:18:58.185189 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Returning 404 to user: Instance c9563934-7879-4c30-8ae5-53605ba0b017 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:18:58.185189 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-119ad343-9340-407d-8704-76ef8adab948 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017" status: 404 len: 111 microversion: 2.1 time: 0.033330 May 26 15:18:58.185189 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 524/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:18:58 2022] GET /compute/v2.1/servers/c9563934-7879-4c30-8ae5-53605ba0b017 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:18:58.187434 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b8e7129f-6677-4f3e-a0d3-feefd220b487 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] Calling method '.version_select at 0x7ff965f8a160>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:18:58.208112 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b8e7129f-6677-4f3e-a0d3-feefd220b487 tempest-TestMinimumBasicScenario-1560269162 tempest-TestMinimumBasicScenario-1560269162-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1582104497" status: 202 len: 0 microversion: 2.1 time: 0.024166 May 26 15:18:58.208690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 545/1069] 10.222.0.46 () {58 vars in 1271 bytes} [Thu May 26 15:18:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1582104497 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:19:26.227222 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:19:26.227866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Thu May 26 15:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:20:24.131852 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=14 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:24.132673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:24.137658 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-763a1eaf-65d4-4d82-8840-0aa2149ee6c8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:24.138161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-763a1eaf-65d4-4d82-8840-0aa2149ee6c8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:24.145419 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-763a1eaf-65d4-4d82-8840-0aa2149ee6c8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:24.145982 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-763a1eaf-65d4-4d82-8840-0aa2149ee6c8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:24.146762 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-763a1eaf-65d4-4d82-8840-0aa2149ee6c8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:24.147206 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-763a1eaf-65d4-4d82-8840-0aa2149ee6c8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:24.173420 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-763a1eaf-65d4-4d82-8840-0aa2149ee6c8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:20:24.258023 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-763a1eaf-65d4-4d82-8840-0aa2149ee6c8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 204 len: 0 microversion: 2.1 time: 0.127509 May 26 15:20:24.258803 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 525/1070] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:20:24 2022] DELETE /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:20:24.267158 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:24.268310 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:24.273922 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-b6d84007-e143-4dd0-9b86-a9b4efd9a0c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:24.274704 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-b6d84007-e143-4dd0-9b86-a9b4efd9a0c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:24.285478 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6d84007-e143-4dd0-9b86-a9b4efd9a0c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:24.285930 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6d84007-e143-4dd0-9b86-a9b4efd9a0c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:24.286713 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6d84007-e143-4dd0-9b86-a9b4efd9a0c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:24.287152 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-b6d84007-e143-4dd0-9b86-a9b4efd9a0c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:24.442534 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-b6d84007-e143-4dd0-9b86-a9b4efd9a0c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:24.452503 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-b6d84007-e143-4dd0-9b86-a9b4efd9a0c4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1577 microversion: 2.1 time: 0.188213 May 26 15:20:24.453090 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 546/1071] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:24 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:25.472388 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-fc9e661d-044c-4b35-8be4-86b13547f068 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:25.473187 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-fc9e661d-044c-4b35-8be4-86b13547f068 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:25.480539 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fc9e661d-044c-4b35-8be4-86b13547f068 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:25.480995 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fc9e661d-044c-4b35-8be4-86b13547f068 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:25.481807 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fc9e661d-044c-4b35-8be4-86b13547f068 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:25.482302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-fc9e661d-044c-4b35-8be4-86b13547f068 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:25.643326 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-fc9e661d-044c-4b35-8be4-86b13547f068 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:25.651680 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-fc9e661d-044c-4b35-8be4-86b13547f068 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1577 microversion: 2.1 time: 0.183650 May 26 15:20:25.652254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 526/1072] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:25 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:26.668226 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-732a2554-5463-4558-8a9d-9ddb997580b1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:26.668991 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-732a2554-5463-4558-8a9d-9ddb997580b1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:26.676171 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-732a2554-5463-4558-8a9d-9ddb997580b1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:26.676628 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-732a2554-5463-4558-8a9d-9ddb997580b1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:26.677410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-732a2554-5463-4558-8a9d-9ddb997580b1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:26.677889 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-732a2554-5463-4558-8a9d-9ddb997580b1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:26.779361 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-732a2554-5463-4558-8a9d-9ddb997580b1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:26.787115 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-732a2554-5463-4558-8a9d-9ddb997580b1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 200 len: 1509 microversion: 2.1 time: 0.122865 May 26 15:20:26.787906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 547/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:26 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 1509 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:27.049607 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-653d3008-feb2-443f-8a78-102b17488b9a req-9614fcb0-2001-4c76-a41b-8dcb3f4c85bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede26c84-934a-4de5-825c-00e32c8c37a8", "name": "network-vif-deleted", "tag": "0bfb8228-ae03-42e8-a883-76fd82ef87da"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:27.058811 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-653d3008-feb2-443f-8a78-102b17488b9a req-9614fcb0-2001-4c76-a41b-8dcb3f4c85bc service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:27.059262 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-653d3008-feb2-443f-8a78-102b17488b9a req-9614fcb0-2001-4c76-a41b-8dcb3f4c85bc service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:27.071056 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-653d3008-feb2-443f-8a78-102b17488b9a req-9614fcb0-2001-4c76-a41b-8dcb3f4c85bc service nova] Creating event network-vif-deleted:0bfb8228-ae03-42e8-a883-76fd82ef87da for instance ede26c84-934a-4de5-825c-00e32c8c37a8 on hv-cinder-78836 May 26 15:20:27.076890 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-653d3008-feb2-443f-8a78-102b17488b9a req-9614fcb0-2001-4c76-a41b-8dcb3f4c85bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224470 May 26 15:20:27.078194 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 527/1074] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:27.805764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:27.806534 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:27.813179 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:27.813831 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:27.814611 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:27.815047 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:27.829776 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] HTTP exception thrown: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Request method failure captured: May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 HTTP/1.1 May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5oQ6-9YPaUQS2TDbiJp9HTUev0ai6TIzt-mgaX6hp8MmFtEy210GS6d0ipUnoqWF8-qM01JX_VSMe_JgC3tY4wPwLWPZObBmXkC9ckgc2-2mXBcxHGOGTH_srGkZjKGsQG5NtNet-FzUEriDsgnHUsB58qLPsVL1l9vPJ2mYRtLs6s May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:20:27.831462 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0b161426dbdc44ff8e52676e1bc21558", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0b161426dbdc44ff8e52676e1bc21558"}]}] May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-TestVolumeBootPattern-542567026 May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-TestVolumeBootPattern-542567026-project May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 176fec434836494a9af12c96be3a8eb0 May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-TestVolumeBootPattern-542567026-project May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:20:27.833313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': 'ede26c84-934a-4de5-825c-00e32c8c37a8'} May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:20:27.834382 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:20:27.835958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:20:27.837523 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Returning 404 to user: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:20:27.837523 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-463cac59-df3f-46c2-8a00-09cec739c70d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 404 len: 111 microversion: 2.1 time: 0.032096 May 26 15:20:27.838809 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 548/1075] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:27 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:20:27.944098 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-500883797", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-690201950", "security_groups": [{"name": "tempest-secgroup-smoke-1286731114"}], "block_device_mapping_v2": [{"uuid": "0c28ae84-4e9a-4271-9d2f-5ba577ce14a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "17e8e6f7-36ad-4695-9496-110a02e0acc3"}]}} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:28.081590 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.network.neutron [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] validate_networks() for [('17e8e6f7-36ad-4695-9496-110a02e0acc3', None, None, None, None, None)] {{(pid=117724) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:20:28.739264 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Flavor limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:20:28.739694 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Image limits 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:20:28.740170 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Flavor pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:20:28.740581 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Image pref 0:0:0 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:20:28.740994 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.virt.hardware [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:20:28.751375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:28.751828 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:28.752675 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:28.753120 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:28.774525 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Getting quotas for project 0b161426dbdc44ff8e52676e1bc21558. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:20:28.779108 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.quota [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Getting quotas for user 176fec434836494a9af12c96be3a8eb0 and project 0b161426dbdc44ff8e52676e1bc21558. Resources: {'cores', 'instances', 'ram'} {{(pid=117724) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:20:28.840071 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Going to run 1 instances... {{(pid=117724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:20:28.842390 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c28ae84-4e9a-4271-9d2f-5ba577ce14a8',volume_size=None,volume_type=None)] {{(pid=117724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:20:28.987658 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-afdc4b27-500a-4f2b-aeda-39761ef19edf tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.048289 May 26 15:20:28.988209 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 528/1076] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:20:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:20:28.998667 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-c4452ed1-1a63-45ff-aa73-8f720bf5062e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:28.999257 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-c4452ed1-1a63-45ff-aa73-8f720bf5062e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:29.069107 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-c4452ed1-1a63-45ff-aa73-8f720bf5062e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:29.076878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-c4452ed1-1a63-45ff-aa73-8f720bf5062e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1093 microversion: 2.1 time: 0.082601 May 26 15:20:29.077474 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 549/1077] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:28 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:30.099054 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c8875d45-c7b3-406b-8976-86fa9599635a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:30.100187 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c8875d45-c7b3-406b-8976-86fa9599635a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:30.108751 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8875d45-c7b3-406b-8976-86fa9599635a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:30.109261 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8875d45-c7b3-406b-8976-86fa9599635a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:30.111261 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8875d45-c7b3-406b-8976-86fa9599635a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:30.112403 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c8875d45-c7b3-406b-8976-86fa9599635a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:30.207935 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c8875d45-c7b3-406b-8976-86fa9599635a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:30.216710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c8875d45-c7b3-406b-8976-86fa9599635a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1199 microversion: 2.1 time: 0.124199 May 26 15:20:30.218150 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 529/1078] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:30 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1199 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:31.235542 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-539d06e6-1d21-4269-b3d6-cbe7606cf0ed tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:31.236175 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-539d06e6-1d21-4269-b3d6-cbe7606cf0ed tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:31.244215 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-539d06e6-1d21-4269-b3d6-cbe7606cf0ed tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.245176 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-539d06e6-1d21-4269-b3d6-cbe7606cf0ed tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:31.245990 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-539d06e6-1d21-4269-b3d6-cbe7606cf0ed tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.246431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-539d06e6-1d21-4269-b3d6-cbe7606cf0ed tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:31.482910 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-539d06e6-1d21-4269-b3d6-cbe7606cf0ed tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:31.494548 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-539d06e6-1d21-4269-b3d6-cbe7606cf0ed tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.262697 May 26 15:20:31.495296 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 550/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:31 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:31.835820 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-a8e43289-6fc2-44a2-89a1-81440c68864b req-4de9895c-67a3-4cbb-8483-2ae8e5025d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99a9241-4425-4244-842f-dac17b3122ff", "tag": "10c83d17-e84b-4c0e-9f27-82daadae8b0c"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:31.847242 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-a8e43289-6fc2-44a2-89a1-81440c68864b req-4de9895c-67a3-4cbb-8483-2ae8e5025d1f service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:31.847695 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-a8e43289-6fc2-44a2-89a1-81440c68864b req-4de9895c-67a3-4cbb-8483-2ae8e5025d1f service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:31.862338 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-a8e43289-6fc2-44a2-89a1-81440c68864b req-4de9895c-67a3-4cbb-8483-2ae8e5025d1f service nova] Creating event network-changed:10c83d17-e84b-4c0e-9f27-82daadae8b0c for instance b99a9241-4425-4244-842f-dac17b3122ff on hv-cinder-78836 May 26 15:20:31.868046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-a8e43289-6fc2-44a2-89a1-81440c68864b req-4de9895c-67a3-4cbb-8483-2ae8e5025d1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036166 May 26 15:20:31.868988 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 530/1080] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:32.512605 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-5997ed59-a257-4940-aabb-8a52e3148802 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:32.513505 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-5997ed59-a257-4940-aabb-8a52e3148802 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:32.520119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5997ed59-a257-4940-aabb-8a52e3148802 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:32.520562 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5997ed59-a257-4940-aabb-8a52e3148802 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:32.521332 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5997ed59-a257-4940-aabb-8a52e3148802 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:32.521800 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-5997ed59-a257-4940-aabb-8a52e3148802 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:32.763835 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-5997ed59-a257-4940-aabb-8a52e3148802 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:32.778853 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-5997ed59-a257-4940-aabb-8a52e3148802 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.268545 May 26 15:20:32.778853 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 551/1081] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:32 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:33.794877 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-3fc3eb8d-e8cc-449a-8c22-1467c0aa782a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:33.795597 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-3fc3eb8d-e8cc-449a-8c22-1467c0aa782a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:33.802540 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3fc3eb8d-e8cc-449a-8c22-1467c0aa782a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:33.802997 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3fc3eb8d-e8cc-449a-8c22-1467c0aa782a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:33.803771 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3fc3eb8d-e8cc-449a-8c22-1467c0aa782a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:33.804212 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-3fc3eb8d-e8cc-449a-8c22-1467c0aa782a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:33.952627 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-3fc3eb8d-e8cc-449a-8c22-1467c0aa782a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:33.960302 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-3fc3eb8d-e8cc-449a-8c22-1467c0aa782a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.170114 May 26 15:20:33.960870 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 531/1082] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:33 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:34.977627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-564f6409-d20d-45ea-8229-13a855e813c3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:34.978212 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-564f6409-d20d-45ea-8229-13a855e813c3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:34.985417 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-564f6409-d20d-45ea-8229-13a855e813c3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:34.985908 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-564f6409-d20d-45ea-8229-13a855e813c3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:34.986701 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-564f6409-d20d-45ea-8229-13a855e813c3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:34.987410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-564f6409-d20d-45ea-8229-13a855e813c3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:35.128037 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-564f6409-d20d-45ea-8229-13a855e813c3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:35.136313 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-564f6409-d20d-45ea-8229-13a855e813c3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.162685 May 26 15:20:35.136884 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 552/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:34 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:35.404431 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:20:35.404742 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Thu May 26 15:20:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:20:36.153957 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-24a207b1-e09f-48a5-864d-7bf93048c3ec tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:36.154606 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-24a207b1-e09f-48a5-864d-7bf93048c3ec tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:36.161738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24a207b1-e09f-48a5-864d-7bf93048c3ec tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:36.162190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24a207b1-e09f-48a5-864d-7bf93048c3ec tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:36.162960 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24a207b1-e09f-48a5-864d-7bf93048c3ec tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:36.163394 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-24a207b1-e09f-48a5-864d-7bf93048c3ec tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:36.311214 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-24a207b1-e09f-48a5-864d-7bf93048c3ec tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:36.320367 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-24a207b1-e09f-48a5-864d-7bf93048c3ec tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.171059 May 26 15:20:36.320943 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 532/1084] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:36 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:37.339071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-f9ca88c9-8a70-4b0e-a780-23898b8d599e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:37.339708 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-f9ca88c9-8a70-4b0e-a780-23898b8d599e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:37.347264 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f9ca88c9-8a70-4b0e-a780-23898b8d599e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:37.347717 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f9ca88c9-8a70-4b0e-a780-23898b8d599e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:37.348498 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f9ca88c9-8a70-4b0e-a780-23898b8d599e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:37.348935 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-f9ca88c9-8a70-4b0e-a780-23898b8d599e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:37.489159 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-f9ca88c9-8a70-4b0e-a780-23898b8d599e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:37.499140 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-f9ca88c9-8a70-4b0e-a780-23898b8d599e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.165511 May 26 15:20:37.499824 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 553/1085] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:37 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:38.524237 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9e27b8a4-1913-4704-80ee-ea895543a138 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:38.526221 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9e27b8a4-1913-4704-80ee-ea895543a138 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:38.534366 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9e27b8a4-1913-4704-80ee-ea895543a138 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:38.534813 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9e27b8a4-1913-4704-80ee-ea895543a138 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:38.535584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9e27b8a4-1913-4704-80ee-ea895543a138 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:38.536024 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9e27b8a4-1913-4704-80ee-ea895543a138 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:38.682399 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-9e27b8a4-1913-4704-80ee-ea895543a138 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:38.689976 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9e27b8a4-1913-4704-80ee-ea895543a138 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.175130 May 26 15:20:38.690559 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 533/1086] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:38 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:39.709561 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-592b24f0-b138-426f-8784-601c04851ad4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:39.710123 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-592b24f0-b138-426f-8784-601c04851ad4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:39.713611 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:39.717757 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-592b24f0-b138-426f-8784-601c04851ad4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:39.718208 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-592b24f0-b138-426f-8784-601c04851ad4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:39.719684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-592b24f0-b138-426f-8784-601c04851ad4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:39.719684 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-592b24f0-b138-426f-8784-601c04851ad4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:39.859053 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-592b24f0-b138-426f-8784-601c04851ad4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:39.867429 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-592b24f0-b138-426f-8784-601c04851ad4 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.161832 May 26 15:20:39.867999 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 554/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:39 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:40.477797 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:40.478695 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=6 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:20:40.623189 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-581c7692-56ed-4b08-813b-6f80c51cf297 req-28f16cd1-482b-4826-b457-7ac85807dbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99a9241-4425-4244-842f-dac17b3122ff", "name": "network-vif-plugged", "status": "completed", "tag": "10c83d17-e84b-4c0e-9f27-82daadae8b0c"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:40.631682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-581c7692-56ed-4b08-813b-6f80c51cf297 req-28f16cd1-482b-4826-b457-7ac85807dbe6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:40.632134 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-581c7692-56ed-4b08-813b-6f80c51cf297 req-28f16cd1-482b-4826-b457-7ac85807dbe6 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:40.645138 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-581c7692-56ed-4b08-813b-6f80c51cf297 req-28f16cd1-482b-4826-b457-7ac85807dbe6 service nova] Creating event network-vif-plugged:10c83d17-e84b-4c0e-9f27-82daadae8b0c for instance b99a9241-4425-4244-842f-dac17b3122ff on hv-cinder-78836 May 26 15:20:40.650246 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-581c7692-56ed-4b08-813b-6f80c51cf297 req-28f16cd1-482b-4826-b457-7ac85807dbe6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176850 May 26 15:20:40.650851 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 534/1088] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:40.884024 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-df8c456e-413e-4f70-9120-f1da5e4fecba tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:40.885366 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-df8c456e-413e-4f70-9120-f1da5e4fecba tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:40.892617 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df8c456e-413e-4f70-9120-f1da5e4fecba tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:40.893075 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df8c456e-413e-4f70-9120-f1da5e4fecba tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:40.893904 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df8c456e-413e-4f70-9120-f1da5e4fecba tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:40.894351 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-df8c456e-413e-4f70-9120-f1da5e4fecba tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:41.060655 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-df8c456e-413e-4f70-9120-f1da5e4fecba tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:41.068347 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-df8c456e-413e-4f70-9120-f1da5e4fecba tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1265 microversion: 2.1 time: 0.188201 May 26 15:20:41.068962 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 555/1089] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:40 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:42.085435 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-ea0a90fd-955e-4f5e-8c6a-d1e15e2bcef9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:42.086171 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-ea0a90fd-955e-4f5e-8c6a-d1e15e2bcef9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:42.092705 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ea0a90fd-955e-4f5e-8c6a-d1e15e2bcef9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:42.093255 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ea0a90fd-955e-4f5e-8c6a-d1e15e2bcef9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:42.094097 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ea0a90fd-955e-4f5e-8c6a-d1e15e2bcef9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:42.094542 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-ea0a90fd-955e-4f5e-8c6a-d1e15e2bcef9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:42.243292 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-ea0a90fd-955e-4f5e-8c6a-d1e15e2bcef9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:42.251589 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-ea0a90fd-955e-4f5e-8c6a-d1e15e2bcef9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1452 microversion: 2.1 time: 0.170836 May 26 15:20:42.252173 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 535/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:42 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:42.268442 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-499b4505-45e0-4b57-931b-98f7e986d436 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:20:42.269048 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-499b4505-45e0-4b57-931b-98f7e986d436 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:20:42.276451 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-499b4505-45e0-4b57-931b-98f7e986d436 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:42.276891 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-499b4505-45e0-4b57-931b-98f7e986d436 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:42.277686 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-499b4505-45e0-4b57-931b-98f7e986d436 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:42.278119 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-499b4505-45e0-4b57-931b-98f7e986d436 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:42.427583 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-499b4505-45e0-4b57-931b-98f7e986d436 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:20:42.436049 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-499b4505-45e0-4b57-931b-98f7e986d436 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1452 microversion: 2.1 time: 0.171473 May 26 15:20:42.436627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 556/1091] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:20:42 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:20:44.419673 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-2f7009da-ddbd-4370-81b1-1da2aae87fce req-ff5ea8bb-8fae-4c30-9ea3-e90ff8f57b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99a9241-4425-4244-842f-dac17b3122ff", "tag": "10c83d17-e84b-4c0e-9f27-82daadae8b0c"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:20:44.428623 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-2f7009da-ddbd-4370-81b1-1da2aae87fce req-ff5ea8bb-8fae-4c30-9ea3-e90ff8f57b24 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:20:44.429378 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-2f7009da-ddbd-4370-81b1-1da2aae87fce req-ff5ea8bb-8fae-4c30-9ea3-e90ff8f57b24 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:20:44.441712 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-2f7009da-ddbd-4370-81b1-1da2aae87fce req-ff5ea8bb-8fae-4c30-9ea3-e90ff8f57b24 service nova] Creating event network-changed:10c83d17-e84b-4c0e-9f27-82daadae8b0c for instance b99a9241-4425-4244-842f-dac17b3122ff on hv-cinder-78836 May 26 15:20:44.447554 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-2f7009da-ddbd-4370-81b1-1da2aae87fce req-ff5ea8bb-8fae-4c30-9ea3-e90ff8f57b24 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030787 May 26 15:20:44.447978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 536/1092] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:20:50.953474 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:20:50.954152 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Thu May 26 15:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:21:13.670757 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:21:13.671298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Thu May 26 15:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:22:17.671200 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=24 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:17.672168 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=56 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:17.676721 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1431653877", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-690201950", "security_groups": [{"name": "tempest-secgroup-smoke-1286731114"}], "block_device_mapping_v2": [{"uuid": "9c14bd50-c926-4e0c-8327-ea0b316cd803", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "17e8e6f7-36ad-4695-9496-110a02e0acc3"}]}} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:17.792342 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.network.neutron [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] validate_networks() for [('17e8e6f7-36ad-4695-9496-110a02e0acc3', None, None, None, None, None)] {{(pid=117723) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 15:22:18.264576 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Flavor limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 15:22:18.265009 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Image limits 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 15:22:18.265523 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Flavor pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 15:22:18.265938 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Image pref 0:0:0 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 15:22:18.266355 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.virt.hardware [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117723) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 15:22:18.275880 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:18.276396 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:18.277144 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:18.277619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:18.298160 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Getting quotas for project 0b161426dbdc44ff8e52676e1bc21558. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 15:22:18.302604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.quota [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Getting quotas for user 176fec434836494a9af12c96be3a8eb0 and project 0b161426dbdc44ff8e52676e1bc21558. Resources: {'cores', 'instances', 'ram'} {{(pid=117723) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 15:22:18.360764 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Going to run 1 instances... {{(pid=117723) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 15:22:18.362896 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c14bd50-c926-4e0c-8327-ea0b316cd803',volume_size=None,volume_type=None)] {{(pid=117723) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 15:22:18.500497 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-264704b3-d02a-4bb6-a301-917e097e453c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831234 May 26 15:22:18.501129 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 557/1093] 10.222.0.46 () {60 vars in 1146 bytes} [Thu May 26 15:22:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:22:18.510168 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:18.511280 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:18.516437 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-0b448e13-6c9f-4986-bf28-ccbc08df690c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:18.517175 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-0b448e13-6c9f-4986-bf28-ccbc08df690c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:18.589183 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-0b448e13-6c9f-4986-bf28-ccbc08df690c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:18.596073 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-0b448e13-6c9f-4986-bf28-ccbc08df690c tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1094 microversion: 2.1 time: 0.088453 May 26 15:22:18.596657 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 537/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:18 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:19.618005 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-28ca1944-5c9f-443f-82f7-53f4052e4558 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:19.619272 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-28ca1944-5c9f-443f-82f7-53f4052e4558 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:19.636146 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-28ca1944-5c9f-443f-82f7-53f4052e4558 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:19.637048 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-28ca1944-5c9f-443f-82f7-53f4052e4558 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:19.638376 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-28ca1944-5c9f-443f-82f7-53f4052e4558 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:19.638844 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-28ca1944-5c9f-443f-82f7-53f4052e4558 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:19.725278 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-28ca1944-5c9f-443f-82f7-53f4052e4558 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:19.733856 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-28ca1944-5c9f-443f-82f7-53f4052e4558 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1200 microversion: 2.1 time: 0.122264 May 26 15:22:19.734445 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 558/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:19 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1200 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:20.753383 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5fdccd28-6bd1-46dd-b721-1a11428f80d9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:20.754830 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5fdccd28-6bd1-46dd-b721-1a11428f80d9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:20.762928 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5fdccd28-6bd1-46dd-b721-1a11428f80d9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:20.763291 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5fdccd28-6bd1-46dd-b721-1a11428f80d9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:20.764079 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5fdccd28-6bd1-46dd-b721-1a11428f80d9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:20.764550 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5fdccd28-6bd1-46dd-b721-1a11428f80d9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:20.972785 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5fdccd28-6bd1-46dd-b721-1a11428f80d9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:20.981417 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5fdccd28-6bd1-46dd-b721-1a11428f80d9 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.233078 May 26 15:22:20.982036 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 538/1096] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:20 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:21.329003 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-b36bf254-797b-4e3d-b461-e9ace6cbd476 req-b16276d7-8887-42b6-9d5b-7404ed0f04a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9afae951-8db9-43e2-a371-b274d48e8135", "tag": "3b2779f6-0c1b-4479-bb77-f44d856d5073"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:21.342588 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b36bf254-797b-4e3d-b461-e9ace6cbd476 req-b16276d7-8887-42b6-9d5b-7404ed0f04a1 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:21.343037 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-b36bf254-797b-4e3d-b461-e9ace6cbd476 req-b16276d7-8887-42b6-9d5b-7404ed0f04a1 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:21.360714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-b36bf254-797b-4e3d-b461-e9ace6cbd476 req-b16276d7-8887-42b6-9d5b-7404ed0f04a1 service nova] Creating event network-changed:3b2779f6-0c1b-4479-bb77-f44d856d5073 for instance 9afae951-8db9-43e2-a371-b274d48e8135 on hv-cinder-78836 May 26 15:22:21.371182 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-b36bf254-797b-4e3d-b461-e9ace6cbd476 req-b16276d7-8887-42b6-9d5b-7404ed0f04a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047900 May 26 15:22:21.372487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 559/1097] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:22:21.999658 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-57c6208b-bd93-4dfb-a0f8-647f50634922 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:22.000295 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-57c6208b-bd93-4dfb-a0f8-647f50634922 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:22.006978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-57c6208b-bd93-4dfb-a0f8-647f50634922 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:22.007428 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-57c6208b-bd93-4dfb-a0f8-647f50634922 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:22.008826 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-57c6208b-bd93-4dfb-a0f8-647f50634922 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:22.009262 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-57c6208b-bd93-4dfb-a0f8-647f50634922 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:22.173826 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-57c6208b-bd93-4dfb-a0f8-647f50634922 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:22.181341 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-57c6208b-bd93-4dfb-a0f8-647f50634922 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.185805 May 26 15:22:22.182005 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 539/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:21 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:23.198679 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0d37ee00-3893-4a9d-a317-7b87f3f33c25 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:23.199374 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0d37ee00-3893-4a9d-a317-7b87f3f33c25 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:23.206124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d37ee00-3893-4a9d-a317-7b87f3f33c25 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:23.206568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d37ee00-3893-4a9d-a317-7b87f3f33c25 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:23.207326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d37ee00-3893-4a9d-a317-7b87f3f33c25 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:23.207757 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0d37ee00-3893-4a9d-a317-7b87f3f33c25 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:23.354799 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0d37ee00-3893-4a9d-a317-7b87f3f33c25 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:23.362714 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0d37ee00-3893-4a9d-a317-7b87f3f33c25 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.168200 May 26 15:22:23.363890 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 560/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:23 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:24.383140 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-8e3c56f9-b9e0-40c1-801b-49207c5994a2 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:24.383780 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-8e3c56f9-b9e0-40c1-801b-49207c5994a2 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:24.391010 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8e3c56f9-b9e0-40c1-801b-49207c5994a2 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:24.391483 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8e3c56f9-b9e0-40c1-801b-49207c5994a2 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:24.392321 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8e3c56f9-b9e0-40c1-801b-49207c5994a2 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:24.392791 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-8e3c56f9-b9e0-40c1-801b-49207c5994a2 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:24.527518 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-8e3c56f9-b9e0-40c1-801b-49207c5994a2 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:24.540313 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-8e3c56f9-b9e0-40c1-801b-49207c5994a2 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.158195 May 26 15:22:24.543466 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 540/1100] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:24 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:25.561864 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a59e61c8-6895-4d8d-842a-ba421d1f54d1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:25.562484 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a59e61c8-6895-4d8d-842a-ba421d1f54d1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:25.568872 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a59e61c8-6895-4d8d-842a-ba421d1f54d1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:25.569321 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a59e61c8-6895-4d8d-842a-ba421d1f54d1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:25.570754 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a59e61c8-6895-4d8d-842a-ba421d1f54d1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:25.571238 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a59e61c8-6895-4d8d-842a-ba421d1f54d1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:25.704142 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a59e61c8-6895-4d8d-842a-ba421d1f54d1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:25.713099 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a59e61c8-6895-4d8d-842a-ba421d1f54d1 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.155081 May 26 15:22:25.713723 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 561/1101] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:25 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:26.731592 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-28d099c0-f99e-41ca-8cd9-7f3603bddf61 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:26.732190 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-28d099c0-f99e-41ca-8cd9-7f3603bddf61 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:26.739109 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28d099c0-f99e-41ca-8cd9-7f3603bddf61 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:26.739558 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28d099c0-f99e-41ca-8cd9-7f3603bddf61 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:26.740336 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28d099c0-f99e-41ca-8cd9-7f3603bddf61 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:26.740770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-28d099c0-f99e-41ca-8cd9-7f3603bddf61 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:26.881038 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-28d099c0-f99e-41ca-8cd9-7f3603bddf61 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:26.889131 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-28d099c0-f99e-41ca-8cd9-7f3603bddf61 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.162475 May 26 15:22:26.889806 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 541/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:26 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:27.908359 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-16ce7815-431b-4f06-a634-f7091a12c8e5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:27.908942 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-16ce7815-431b-4f06-a634-f7091a12c8e5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:27.916085 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-16ce7815-431b-4f06-a634-f7091a12c8e5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:27.916536 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-16ce7815-431b-4f06-a634-f7091a12c8e5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:27.917298 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-16ce7815-431b-4f06-a634-f7091a12c8e5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:27.917762 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-16ce7815-431b-4f06-a634-f7091a12c8e5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:28.062110 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-16ce7815-431b-4f06-a634-f7091a12c8e5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:28.070451 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-16ce7815-431b-4f06-a634-f7091a12c8e5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.165440 May 26 15:22:28.071055 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 562/1103] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:27 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:29.086549 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-be92e5a6-e852-487c-a367-7bf98bc9151d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:29.087314 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-be92e5a6-e852-487c-a367-7bf98bc9151d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:29.091524 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell0:SELECT=2 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:29.097991 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-be92e5a6-e852-487c-a367-7bf98bc9151d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:29.098348 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-be92e5a6-e852-487c-a367-7bf98bc9151d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:29.099031 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-be92e5a6-e852-487c-a367-7bf98bc9151d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:29.099731 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-be92e5a6-e852-487c-a367-7bf98bc9151d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:29.248161 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-be92e5a6-e852-487c-a367-7bf98bc9151d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:29.256060 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-be92e5a6-e852-487c-a367-7bf98bc9151d tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.173303 May 26 15:22:29.256629 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 542/1104] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:29 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:30.274866 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-32940d10-f17d-41c3-bf49-bf8fb7de179a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:30.275477 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-32940d10-f17d-41c3-bf49-bf8fb7de179a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:30.277688 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=2 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:30.278349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell0:SELECT=6 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:22:30.285204 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32940d10-f17d-41c3-bf49-bf8fb7de179a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:30.285690 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32940d10-f17d-41c3-bf49-bf8fb7de179a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:30.286480 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32940d10-f17d-41c3-bf49-bf8fb7de179a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:30.286924 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-32940d10-f17d-41c3-bf49-bf8fb7de179a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:30.430358 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-32940d10-f17d-41c3-bf49-bf8fb7de179a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:30.440427 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-32940d10-f17d-41c3-bf49-bf8fb7de179a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.169145 May 26 15:22:30.441190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 563/1105] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:30 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:31.458236 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-11cf3af3-8790-45d2-b2ae-9f6da74dd55a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:31.463649 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-11cf3af3-8790-45d2-b2ae-9f6da74dd55a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:31.465802 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cf3af3-8790-45d2-b2ae-9f6da74dd55a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:31.466251 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cf3af3-8790-45d2-b2ae-9f6da74dd55a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:31.467014 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cf3af3-8790-45d2-b2ae-9f6da74dd55a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:31.467451 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-11cf3af3-8790-45d2-b2ae-9f6da74dd55a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:31.871624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-11cf3af3-8790-45d2-b2ae-9f6da74dd55a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:31.880784 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-11cf3af3-8790-45d2-b2ae-9f6da74dd55a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.426156 May 26 15:22:31.881334 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 543/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:31 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:32.898726 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6df1a3cc-c506-41a2-8911-c9d8aaab9dd5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:32.899349 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-6df1a3cc-c506-41a2-8911-c9d8aaab9dd5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:32.906122 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6df1a3cc-c506-41a2-8911-c9d8aaab9dd5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:32.906604 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6df1a3cc-c506-41a2-8911-c9d8aaab9dd5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:32.907403 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6df1a3cc-c506-41a2-8911-c9d8aaab9dd5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:32.907845 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-6df1a3cc-c506-41a2-8911-c9d8aaab9dd5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:32.932375 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-e6df6ac0-c574-4398-8ef7-8207ba6623a7 req-9e2aa26b-59ad-4934-b25d-e917fc0e8167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9afae951-8db9-43e2-a371-b274d48e8135", "name": "network-vif-plugged", "status": "completed", "tag": "3b2779f6-0c1b-4479-bb77-f44d856d5073"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:32.946239 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-e6df6ac0-c574-4398-8ef7-8207ba6623a7 req-9e2aa26b-59ad-4934-b25d-e917fc0e8167 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:32.946720 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-e6df6ac0-c574-4398-8ef7-8207ba6623a7 req-9e2aa26b-59ad-4934-b25d-e917fc0e8167 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:32.958891 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-e6df6ac0-c574-4398-8ef7-8207ba6623a7 req-9e2aa26b-59ad-4934-b25d-e917fc0e8167 service nova] Creating event network-vif-plugged:3b2779f6-0c1b-4479-bb77-f44d856d5073 for instance 9afae951-8db9-43e2-a371-b274d48e8135 on hv-cinder-78836 May 26 15:22:32.967137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-e6df6ac0-c574-4398-8ef7-8207ba6623a7 req-9e2aa26b-59ad-4934-b25d-e917fc0e8167 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036316 May 26 15:22:32.967137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 544/1107] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:22:33.061635 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-6df1a3cc-c506-41a2-8911-c9d8aaab9dd5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:33.077906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6df1a3cc-c506-41a2-8911-c9d8aaab9dd5 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.183265 May 26 15:22:33.078916 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 564/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:32 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:34.103940 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-e33b32c6-8ef3-428e-b2da-4b9774833748 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:34.104874 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-e33b32c6-8ef3-428e-b2da-4b9774833748 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:34.111615 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e33b32c6-8ef3-428e-b2da-4b9774833748 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:34.112072 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e33b32c6-8ef3-428e-b2da-4b9774833748 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:34.112840 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e33b32c6-8ef3-428e-b2da-4b9774833748 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:34.113281 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-e33b32c6-8ef3-428e-b2da-4b9774833748 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:34.247354 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-e33b32c6-8ef3-428e-b2da-4b9774833748 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:34.260404 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-e33b32c6-8ef3-428e-b2da-4b9774833748 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1266 microversion: 2.1 time: 0.161637 May 26 15:22:34.260983 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 545/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:34 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:35.278650 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-51fd63bf-a54c-4363-b107-a6ab7cf353d8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:35.279568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-51fd63bf-a54c-4363-b107-a6ab7cf353d8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:35.287133 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-51fd63bf-a54c-4363-b107-a6ab7cf353d8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:35.287593 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-51fd63bf-a54c-4363-b107-a6ab7cf353d8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:35.288487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-51fd63bf-a54c-4363-b107-a6ab7cf353d8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:35.289083 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-51fd63bf-a54c-4363-b107-a6ab7cf353d8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:35.429360 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-51fd63bf-a54c-4363-b107-a6ab7cf353d8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:35.439322 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-51fd63bf-a54c-4363-b107-a6ab7cf353d8 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1453 microversion: 2.1 time: 0.165203 May 26 15:22:35.439936 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 565/1110] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:35 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:35.456464 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-c06df29a-4722-4b63-889e-20607266ec53 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:22:35.457115 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-c06df29a-4722-4b63-889e-20607266ec53 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:22:35.464049 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c06df29a-4722-4b63-889e-20607266ec53 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:35.464487 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c06df29a-4722-4b63-889e-20607266ec53 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:35.465253 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c06df29a-4722-4b63-889e-20607266ec53 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:35.465832 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-c06df29a-4722-4b63-889e-20607266ec53 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:35.601792 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-c06df29a-4722-4b63-889e-20607266ec53 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:22:35.610816 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-c06df29a-4722-4b63-889e-20607266ec53 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1453 microversion: 2.1 time: 0.158385 May 26 15:22:35.611385 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 546/1111] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:22:35 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:22:37.271621 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-6d4963cf-1e82-472d-92ca-ab8b986f1858 req-d32c6085-4486-4890-9d04-998522216bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9afae951-8db9-43e2-a371-b274d48e8135", "tag": "3b2779f6-0c1b-4479-bb77-f44d856d5073"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:22:37.280183 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-6d4963cf-1e82-472d-92ca-ab8b986f1858 req-d32c6085-4486-4890-9d04-998522216bfa service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:22:37.280627 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-6d4963cf-1e82-472d-92ca-ab8b986f1858 req-d32c6085-4486-4890-9d04-998522216bfa service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:22:37.292427 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-6d4963cf-1e82-472d-92ca-ab8b986f1858 req-d32c6085-4486-4890-9d04-998522216bfa service nova] Creating event network-changed:3b2779f6-0c1b-4479-bb77-f44d856d5073 for instance 9afae951-8db9-43e2-a371-b274d48e8135 on hv-cinder-78836 May 26 15:22:37.299266 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-6d4963cf-1e82-472d-92ca-ab8b986f1858 req-d32c6085-4486-4890-9d04-998522216bfa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031239 May 26 15:22:37.299906 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 566/1112] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:05.830520 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:05.831246 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG dbcounter [-] [117723] Writing DB stats nova_cell1:SELECT=48 {{(pid=117723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:05.831983 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_api:SELECT=22 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:05.832978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG dbcounter [-] [117724] Writing DB stats nova_cell1:SELECT=50 {{(pid=117724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 15:24:05.840007 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f0724595-7a92-4df7-8c38-571276c6a1da tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:05.840506 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f0724595-7a92-4df7-8c38-571276c6a1da tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:05.853832 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f0724595-7a92-4df7-8c38-571276c6a1da tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:05.854925 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f0724595-7a92-4df7-8c38-571276c6a1da tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:05.855711 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f0724595-7a92-4df7-8c38-571276c6a1da tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:05.856153 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f0724595-7a92-4df7-8c38-571276c6a1da tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:05.881856 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f0724595-7a92-4df7-8c38-571276c6a1da tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Going to try to terminate instance {{(pid=117724) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:24:05.943190 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-6a293e05-ad11-4980-814b-4bd714df3520 req-d5eaad58-59e9-4999-b1bf-b9f162c3ad7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9afae951-8db9-43e2-a371-b274d48e8135", "tag": "3b2779f6-0c1b-4479-bb77-f44d856d5073"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:05.963302 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-6a293e05-ad11-4980-814b-4bd714df3520 req-d5eaad58-59e9-4999-b1bf-b9f162c3ad7a service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:05.965179 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-6a293e05-ad11-4980-814b-4bd714df3520 req-d5eaad58-59e9-4999-b1bf-b9f162c3ad7a service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:05.966416 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f0724595-7a92-4df7-8c38-571276c6a1da tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 204 len: 0 microversion: 2.1 time: 0.140754 May 26 15:24:05.970311 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 547/1113] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:24:05 2022] DELETE /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:24:05.978786 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-f79607e6-a33a-466b-b371-ff3162657149 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:05.980741 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-f79607e6-a33a-466b-b371-ff3162657149 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:05.985568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-6a293e05-ad11-4980-814b-4bd714df3520 req-d5eaad58-59e9-4999-b1bf-b9f162c3ad7a service nova] Creating event network-changed:3b2779f6-0c1b-4479-bb77-f44d856d5073 for instance 9afae951-8db9-43e2-a371-b274d48e8135 on hv-cinder-78836 May 26 15:24:05.987266 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f79607e6-a33a-466b-b371-ff3162657149 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:05.987709 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f79607e6-a33a-466b-b371-ff3162657149 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:05.988517 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f79607e6-a33a-466b-b371-ff3162657149 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:05.988942 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-f79607e6-a33a-466b-b371-ff3162657149 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:05.991288 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-6a293e05-ad11-4980-814b-4bd714df3520 req-d5eaad58-59e9-4999-b1bf-b9f162c3ad7a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163489 May 26 15:24:05.991875 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 567/1114] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:06.176678 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-f79607e6-a33a-466b-b371-ff3162657149 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:06.184652 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-f79607e6-a33a-466b-b371-ff3162657149 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1578 microversion: 2.1 time: 0.211943 May 26 15:24:06.185212 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 548/1115] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:05 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:07.204162 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-3a25ceae-a133-407e-a328-f9cd2fe1fcb3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:07.204870 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-3a25ceae-a133-407e-a328-f9cd2fe1fcb3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:07.211662 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a25ceae-a133-407e-a328-f9cd2fe1fcb3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:07.212118 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a25ceae-a133-407e-a328-f9cd2fe1fcb3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:07.212882 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a25ceae-a133-407e-a328-f9cd2fe1fcb3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:07.213326 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-3a25ceae-a133-407e-a328-f9cd2fe1fcb3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:07.427216 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-3a25ceae-a133-407e-a328-f9cd2fe1fcb3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:07.434559 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-3a25ceae-a133-407e-a328-f9cd2fe1fcb3 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1578 microversion: 2.1 time: 0.234637 May 26 15:24:07.435108 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 568/1116] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:07 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:08.452708 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-5441eb26-2c9c-4b54-8f1a-27b0892984df tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:08.453322 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-5441eb26-2c9c-4b54-8f1a-27b0892984df tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:08.463738 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5441eb26-2c9c-4b54-8f1a-27b0892984df tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:08.464295 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5441eb26-2c9c-4b54-8f1a-27b0892984df tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:08.465282 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5441eb26-2c9c-4b54-8f1a-27b0892984df tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:08.465866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-5441eb26-2c9c-4b54-8f1a-27b0892984df tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:08.525230 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [req-fcb899a5-263d-43af-8783-cc80b04676da req-9ea30cd5-1685-4edb-be1e-967baa12be95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9afae951-8db9-43e2-a371-b274d48e8135", "name": "network-vif-deleted", "tag": "3b2779f6-0c1b-4479-bb77-f44d856d5073"}]} {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:08.534057 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-fcb899a5-263d-43af-8783-cc80b04676da req-9ea30cd5-1685-4edb-be1e-967baa12be95 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:08.534596 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [req-fcb899a5-263d-43af-8783-cc80b04676da req-9ea30cd5-1685-4edb-be1e-967baa12be95 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:08.542714 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-5441eb26-2c9c-4b54-8f1a-27b0892984df tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:08.549575 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.compute.server_external_events [req-fcb899a5-263d-43af-8783-cc80b04676da req-9ea30cd5-1685-4edb-be1e-967baa12be95 service nova] Creating event network-vif-deleted:3b2779f6-0c1b-4479-bb77-f44d856d5073 for instance 9afae951-8db9-43e2-a371-b274d48e8135 on hv-cinder-78836 May 26 15:24:08.551710 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-5441eb26-2c9c-4b54-8f1a-27b0892984df tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 200 len: 1391 microversion: 2.1 time: 0.103298 May 26 15:24:08.552396 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 549/1117] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:08 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 1391 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:08.565383 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [req-fcb899a5-263d-43af-8783-cc80b04676da req-9ea30cd5-1685-4edb-be1e-967baa12be95 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044008 May 26 15:24:08.566079 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 569/1118] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:24:09.570508 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:09.571160 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: 9afae951-8db9-43e2-a371-b274d48e8135] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:09.577671 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:09.578128 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:09.578894 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:09.579339 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:09.593107 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] HTTP exception thrown: Instance 9afae951-8db9-43e2-a371-b274d48e8135 could not be found. May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Request method failure captured: May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 HTTP/1.1 May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5oQ6-9YPaUQS2TDbiJp9HTUev0ai6TIzt-mgaX6hp8MmFtEy210GS6d0ipUnoqWF8-qM01JX_VSMe_JgC3tY4wPwLWPZObBmXkC9ckgc2-2mXBcxHGOGTH_srGkZjKGsQG5NtNet-FzUEriDsgnHUsB58qLPsVL1l9vPJ2mYRtLs6s May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:24:09.594776 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0b161426dbdc44ff8e52676e1bc21558", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0b161426dbdc44ff8e52676e1bc21558"}]}] May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-TestVolumeBootPattern-542567026 May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-TestVolumeBootPattern-542567026-project May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 176fec434836494a9af12c96be3a8eb0 May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-TestVolumeBootPattern-542567026-project May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance 9afae951-8db9-43e2-a371-b274d48e8135 could not be found. May 26 15:24:09.596494 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': '9afae951-8db9-43e2-a371-b274d48e8135'} May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9afae951-8db9-43e2-a371-b274d48e8135 could not be found. May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:24:09.597511 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9afae951-8db9-43e2-a371-b274d48e8135 could not be found. May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9afae951-8db9-43e2-a371-b274d48e8135 could not be found. May 26 15:24:09.599110 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:09.600497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Returning 404 to user: Instance 9afae951-8db9-43e2-a371-b274d48e8135 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:24:09.600497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-714bd4f3-84e0-4f33-bb07-67cb8fcef20a tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135" status: 404 len: 111 microversion: 2.1 time: 0.029626 May 26 15:24:09.600497 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 550/1119] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:09 2022] GET /compute/v2.1/servers/9afae951-8db9-43e2-a371-b274d48e8135 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:24:10.962417 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:24:10.963029 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Thu May 26 15:24:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:24:12.625205 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-81a965be-aa19-4a90-b76e-0587d2ee93ab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:12.626256 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-81a965be-aa19-4a90-b76e-0587d2ee93ab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:12.627376 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-88e522ea-f161-4705-9220-265624791465 req-117e6153-64e5-4f7b-b25f-27593f1f1257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99a9241-4425-4244-842f-dac17b3122ff", "tag": "10c83d17-e84b-4c0e-9f27-82daadae8b0c"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:12.632745 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-81a965be-aa19-4a90-b76e-0587d2ee93ab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:12.633193 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-81a965be-aa19-4a90-b76e-0587d2ee93ab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:12.634141 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-81a965be-aa19-4a90-b76e-0587d2ee93ab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:12.634584 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-81a965be-aa19-4a90-b76e-0587d2ee93ab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:12.635866 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-88e522ea-f161-4705-9220-265624791465 req-117e6153-64e5-4f7b-b25f-27593f1f1257 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:12.636318 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-88e522ea-f161-4705-9220-265624791465 req-117e6153-64e5-4f7b-b25f-27593f1f1257 service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:12.647377 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-88e522ea-f161-4705-9220-265624791465 req-117e6153-64e5-4f7b-b25f-27593f1f1257 service nova] Creating event network-changed:10c83d17-e84b-4c0e-9f27-82daadae8b0c for instance b99a9241-4425-4244-842f-dac17b3122ff on hv-cinder-78836 May 26 15:24:12.653315 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-88e522ea-f161-4705-9220-265624791465 req-117e6153-64e5-4f7b-b25f-27593f1f1257 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029456 May 26 15:24:12.654196 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 551/1120] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:12.663392 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-81a965be-aa19-4a90-b76e-0587d2ee93ab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Going to try to terminate instance {{(pid=117723) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 15:24:12.761025 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-81a965be-aa19-4a90-b76e-0587d2ee93ab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 204 len: 0 microversion: 2.1 time: 0.138617 May 26 15:24:12.761878 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 570/1121] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:24:12 2022] DELETE /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:24:12.776949 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-75b5b94a-a0be-46b0-bb37-dfb68ef4cf2e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:12.778077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-75b5b94a-a0be-46b0-bb37-dfb68ef4cf2e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:12.784907 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75b5b94a-a0be-46b0-bb37-dfb68ef4cf2e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:12.785363 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75b5b94a-a0be-46b0-bb37-dfb68ef4cf2e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:12.786239 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75b5b94a-a0be-46b0-bb37-dfb68ef4cf2e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:12.786978 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-75b5b94a-a0be-46b0-bb37-dfb68ef4cf2e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:12.945077 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.policy [None req-75b5b94a-a0be-46b0-bb37-dfb68ef4cf2e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117724) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:12.952770 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-75b5b94a-a0be-46b0-bb37-dfb68ef4cf2e tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1577 microversion: 2.1 time: 0.184665 May 26 15:24:12.953342 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 552/1122] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:12 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:13.969964 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-a45ddb8e-7b93-4900-a345-e24fdeb23d0b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:13.970665 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-a45ddb8e-7b93-4900-a345-e24fdeb23d0b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:13.976995 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a45ddb8e-7b93-4900-a345-e24fdeb23d0b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:13.977443 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a45ddb8e-7b93-4900-a345-e24fdeb23d0b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:13.978299 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a45ddb8e-7b93-4900-a345-e24fdeb23d0b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:13.979279 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-a45ddb8e-7b93-4900-a345-e24fdeb23d0b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:14.195327 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-a45ddb8e-7b93-4900-a345-e24fdeb23d0b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:14.202797 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-a45ddb8e-7b93-4900-a345-e24fdeb23d0b tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1577 microversion: 2.1 time: 0.237082 May 26 15:24:14.203358 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 571/1123] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:13 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:14.831424 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [req-9ba2e2f3-008b-4b4e-90dd-39f0200c634a req-bb7aa9f4-6ec7-43dd-b316-55857b8d364b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99a9241-4425-4244-842f-dac17b3122ff", "name": "network-vif-deleted", "tag": "10c83d17-e84b-4c0e-9f27-82daadae8b0c"}]} {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:24:14.839975 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-9ba2e2f3-008b-4b4e-90dd-39f0200c634a req-bb7aa9f4-6ec7-43dd-b316-55857b8d364b service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:14.840418 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [req-9ba2e2f3-008b-4b4e-90dd-39f0200c634a req-bb7aa9f4-6ec7-43dd-b316-55857b8d364b service nova] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:14.851412 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.compute.server_external_events [req-9ba2e2f3-008b-4b4e-90dd-39f0200c634a req-bb7aa9f4-6ec7-43dd-b316-55857b8d364b service nova] Creating event network-vif-deleted:10c83d17-e84b-4c0e-9f27-82daadae8b0c for instance b99a9241-4425-4244-842f-dac17b3122ff on hv-cinder-78836 May 26 15:24:14.856936 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [req-9ba2e2f3-008b-4b4e-90dd-39f0200c634a req-bb7aa9f4-6ec7-43dd-b316-55857b8d364b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029141 May 26 15:24:14.857617 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 553/1124] 10.222.0.46 () {64 vars in 1317 bytes} [Thu May 26 15:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:24:15.220566 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:15.221499 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:15.233827 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:15.234288 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:15.235071 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:15.235510 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:15.269065 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:15.269619 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:15.269993 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.objects.instance [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lazy-loading 'fault' on Instance uuid b99a9241-4425-4244-842f-dac17b3122ff {{(pid=117723) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 15:24:15.311254 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.policy [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176fec434836494a9af12c96be3a8eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b161426dbdc44ff8e52676e1bc21558', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117723) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:24:15.318681 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-0a784a9e-8d67-4264-a866-124a5a153869 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 200 len: 1229 microversion: 2.1 time: 0.102736 May 26 15:24:15.319241 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 572/1125] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:15 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:24:16.336083 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:16.336788 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: b99a9241-4425-4244-842f-dac17b3122ff] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:16.343143 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.343596 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.344356 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.344794 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.358248 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] HTTP exception thrown: Instance b99a9241-4425-4244-842f-dac17b3122ff could not be found. May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Request method failure captured: May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff HTTP/1.1 May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5oQ6-9YPaUQS2TDbiJp9HTUev0ai6TIzt-mgaX6hp8MmFtEy210GS6d0ipUnoqWF8-qM01JX_VSMe_JgC3tY4wPwLWPZObBmXkC9ckgc2-2mXBcxHGOGTH_srGkZjKGsQG5NtNet-FzUEriDsgnHUsB58qLPsVL1l9vPJ2mYRtLs6s May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:24:16.359838 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0b161426dbdc44ff8e52676e1bc21558", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0b161426dbdc44ff8e52676e1bc21558"}]}] May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-TestVolumeBootPattern-542567026-project May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 176fec434836494a9af12c96be3a8eb0 May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-TestVolumeBootPattern-542567026-project May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance b99a9241-4425-4244-842f-dac17b3122ff could not be found. May 26 15:24:16.361584 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': 'b99a9241-4425-4244-842f-dac17b3122ff'} May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99a9241-4425-4244-842f-dac17b3122ff could not be found. May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:24:16.362821 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99a9241-4425-4244-842f-dac17b3122ff could not be found. May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99a9241-4425-4244-842f-dac17b3122ff could not be found. May 26 15:24:16.364574 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.366120 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Returning 404 to user: Instance b99a9241-4425-4244-842f-dac17b3122ff could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:24:16.366120 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-96d71173-8982-49f3-872a-d2e5c10e4715 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff" status: 404 len: 111 microversion: 2.1 time: 0.030004 May 26 15:24:16.366120 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 554/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:16 2022] GET /compute/v2.1/servers/b99a9241-4425-4244-842f-dac17b3122ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:24:16.800958 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:16.801491 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.compute.api [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117723) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:16.808487 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.809045 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.809923 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.810358 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG oslo_concurrency.lockutils [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.823342 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.wsgi [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] HTTP exception thrown: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Request method failure captured: May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: request: DELETE /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 HTTP/1.1 May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept: application/json May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Accept-Encoding: identity May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Connection: close May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Length: 0 May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Content-Type: application/json May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Host: 10.222.0.46 May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Openstack-System-Scope: None May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: User-Agent: python-urllib3/1.26.9 May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Auth-Token: gAAAAABij5oQ6-9YPaUQS2TDbiJp9HTUev0ai6TIzt-mgaX6hp8MmFtEy210GS6d0ipUnoqWF8-qM01JX_VSMe_JgC3tY4wPwLWPZObBmXkC9ckgc2-2mXBcxHGOGTH_srGkZjKGsQG5NtNet-FzUEriDsgnHUsB58qLPsVL1l9vPJ2mYRtLs6s May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Id: None May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Domain-Name: None May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Identity-Status: Confirmed May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Is-Admin-Project: True May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Id: default May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Domain-Name: Default May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Project-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Role: reader,member May 26 15:24:16.824986 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Roles: reader,member May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0b161426dbdc44ff8e52676e1bc21558", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0b161426dbdc44ff8e52676e1bc21558"}]}] May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-Tenant-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User: tempest-TestVolumeBootPattern-542567026-project May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Id: default May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Domain-Name: Default May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Id: 176fec434836494a9af12c96be3a8eb0 May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: X-User-Name: tempest-TestVolumeBootPattern-542567026-project May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: method: > May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: exception: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.826644 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: action_args: {'id': 'ede26c84-934a-4de5-825c-00e32c8c37a8'} May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:24:16.827568 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.829124 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR nova.api.openstack.wsgi May 26 15:24:16.830656 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Returning 404 to user: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. {{(pid=117723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:24:16.830656 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-cde9d15f-f45c-4955-b20b-eae966cf1fab tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 404 len: 111 microversion: 2.1 time: 0.029283 May 26 15:24:16.830656 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 573/1127] 10.222.0.46 () {58 vars in 1238 bytes} [Thu May 26 15:24:16 2022] DELETE /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:24:16.835064 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '>' {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:16.835682 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.compute.api [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [instance: ede26c84-934a-4de5-825c-00e32c8c37a8] Fetching instance by UUID {{(pid=117724) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 15:24:16.841801 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.842254 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.843042 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 15:24:16.843481 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG oslo_concurrency.lockutils [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Lock "f6457610-a8a6-401c-aab2-670bbc3dd86d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 15:24:16.857235 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.wsgi [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] HTTP exception thrown: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Request method failure captured: May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: request: GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 HTTP/1.1 May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept: application/json May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Accept-Encoding: identity May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Connection: close May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Length: 0 May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Content-Type: application/json May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Host: 10.222.0.46 May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Openstack-System-Scope: None May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: User-Agent: python-urllib3/1.26.9 May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Auth-Token: gAAAAABij5oQ6-9YPaUQS2TDbiJp9HTUev0ai6TIzt-mgaX6hp8MmFtEy210GS6d0ipUnoqWF8-qM01JX_VSMe_JgC3tY4wPwLWPZObBmXkC9ckgc2-2mXBcxHGOGTH_srGkZjKGsQG5NtNet-FzUEriDsgnHUsB58qLPsVL1l9vPJ2mYRtLs6s May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Id: None May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Domain-Name: None May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Identity-Status: Confirmed May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Is-Admin-Project: True May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Id: default May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Domain-Name: Default May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Project-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Role: reader,member May 26 15:24:16.859046 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Roles: reader,member May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0b161426dbdc44ff8e52676e1bc21558"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0b161426dbdc44ff8e52676e1bc21558", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0b161426dbdc44ff8e52676e1bc21558"}]}] May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Id: 0b161426dbdc44ff8e52676e1bc21558 May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-Tenant-Name: tempest-TestVolumeBootPattern-542567026 May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User: tempest-TestVolumeBootPattern-542567026-project May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Id: default May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Domain-Name: Default May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Id: 176fec434836494a9af12c96be3a8eb0 May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: X-User-Name: tempest-TestVolumeBootPattern-542567026-project May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: method: > May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: exception: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.860696 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: action_args: {'id': 'ede26c84-934a-4de5-825c-00e32c8c37a8'} May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: {{(pid=117724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 15:24:16.861624 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. May 26 15:24:16.863191 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: ERROR nova.api.openstack.wsgi May 26 15:24:16.864630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: DEBUG nova.api.openstack.wsgi [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Returning 404 to user: Instance ede26c84-934a-4de5-825c-00e32c8c37a8 could not be found. {{(pid=117724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 15:24:16.864630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO nova.api.openstack.requestlog [None req-9d6d71fe-4f49-41da-90f6-7bd2dbed0766 tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8" status: 404 len: 111 microversion: 2.1 time: 0.029205 May 26 15:24:16.864630 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: [pid: 117724|app: 0|req: 555/1128] 10.222.0.46 () {58 vars in 1235 bytes} [Thu May 26 15:24:16 2022] GET /compute/v2.1/servers/ede26c84-934a-4de5-825c-00e32c8c37a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:24:18.140410 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: DEBUG nova.api.openstack.wsgi [None req-6407a35b-68ad-4832-9d9e-55721f9613fe tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] Calling method '.version_select at 0x7ff966a813a0>' {{(pid=117723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:24:18.143623 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6407a35b-68ad-4832-9d9e-55721f9613fe tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [a3a03ed2-d170-4759-8181-acfb914d9e9e] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 15:24:19.151746 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [None req-6407a35b-68ad-4832-9d9e-55721f9613fe tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] [a3a03ed2-d170-4759-8181-acfb914d9e9e] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 49978. May 26 15:24:19.170886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO nova.api.openstack.requestlog [None req-6407a35b-68ad-4832-9d9e-55721f9613fe tempest-TestVolumeBootPattern-542567026 tempest-TestVolumeBootPattern-542567026-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-690201950" status: 202 len: 0 microversion: 2.1 time: 1.034286 May 26 15:24:19.171449 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: [pid: 117723|app: 0|req: 574/1129] 10.222.0.46 () {58 vars in 1259 bytes} [Thu May 26 15:24:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-690201950 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:25:35.414886 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:25:35.415636 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Thu May 26 15:25:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:26:06.240591 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:26:06.241137 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Thu May 26 15:26:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:27:30.970622 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:27:30.971535 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Thu May 26 15:27:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:28:55.423642 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:28:55.424393 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Thu May 26 15:28:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:29:18.232648 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:29:18.233343 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Thu May 26 15:29:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:29:26.248781 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:29:26.249304 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Thu May 26 15:29:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:29:33.685722 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:29:33.686216 dv-cinder-788367-11-iscsi devstack@n-api.service[117723]: Thu May 26 15:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:29:34.864844 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:29:34.865382 dv-cinder-788367-11-iscsi devstack@n-api.service[117724]: Thu May 26 15:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!